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Using  IQ  and  achievement  scores  from  75  students 

referred  for  a  suspected  learning  disability  (LD) ,  this 

study  systematically  compared  the  effects  of  the  following 

three  discrepancy  methods  on  LD  identification:     (a)  Simple 

Difference  method  (i.e.,  standard  score  comparison),  (b) 

Frequency  of  Regression  Prediction  Discrepancy  (Reynolds' 

Model  Three  regression  method),  and  (c)  the  method  recently 

proposed  for  adoption  by  the  Florida  Department  of 

Education.     This  third  method  employs  formulas  that  are 

mathematically  equivalent  to  Regression  Estimates  of  True 

Discrepancy  Scores  (Reynolds'  Model  Four).     In  this  study, 

each  student  was  evaluated  with  the  Wechsler  Intelligence 

Scale  for  Children  -  Third  Edition  (WISC-III)  and  either  the 

Woodcock- Johnson  Psychoeducational  Battery  (Revised)  -  Tests 
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of  Achievement  (WJ-R)   (n=47)  or  the  Kaufman  Test  of 
Educational  Achievement  (K-TEA)   (ii=28).     It  was  hypothesized 
that  the  methods  would  identify  disproportionate  numbers  of 
students  as  eligible  for  learning  disability  services,  and 
that  significant  differences  would  exist  between  methods  in 
the  degree  of  selection  bias  for  IQ,  due  to  regression 
toward  the  mean  effects.     A  Cochran  Q  test  for  related 
samples  was  conducted  to  determine  if  the  methods  selected 
different  proportions  of  students  as  having  LD.     The  three 
discrepancy  methods  were  found  to  identify  significantly 
different  proportions  of  students  (K-TEA,  p  <   .05;  WJ-R, 
p  <  .001).     Additionally,  results  indicate  that  the  model 
proposed  by  the  Florida  Department  of  Education  identified 
the  fewest  students  overall.     The  model  proposed  by  the 
Florida  Department  of  Education  and  the  Simple  Difference 
method  both  identified  disproportionately  fewer  students  at 
low  IQ  levels.     Reynolds'  Model  Three  regression  method  most 
evenly  distributed  LD  identification  across  ability  levels, 
supporting  the  proposition  that  it  best  corrects  for 
regression  toward  the  mean  effects.     In  conclusion,  these 
findings  suggest  that  the  three  methods  compared  cannot  be 
used  interchangeably  in  the  calculation  of  a  severe 
discrepancy  and  that  Reynolds'  Model  Three  regression  method 
may  be  the  most  viable  for  selection  as  a  best  practice 
method . 


V 


INTRODUCTION 

In  the  field  of  learning  disabilities  (LD) ,  the 
relative  merits  of  discrepancy  formulas  is  one  of  the  most 
intensely  debated  issues  (Haramill,  1990).     The  discrepancy 
between  a  child's  IQ  and  achievement  scores  is  the  most 
commonly  used  criterion  for  determining  if  a  child  is 
eligible  for  LD  services.     Considerable  variability  exists, 
however,  between  states'  methods  for  operationalizing  a 
" severe  discrepancy . " 

Although  states  appear  to  be  moving  toward  more 
sophisticated  methods  of  quantifying  a  discrepancy  between 
aptitude  and  achievement,  many  are  reportedly  still  using 
methods  with  proven  psychometric  shortcomings  (Mercer,  King- 
Sears,  &  Mercer,  1990).     There  is  a  current  need  in  the 
field  to  improve  LD  identification  practices  through  the 
consistent  selection  of  a  sound  discrepancy  method. 
Although  regression  discrepancy  methods  are  generally 
recognized  to  be  the  most  psychometrically  sound,  the  Simple 
Difference  method,  which  involves  a  simple  standard  score 
comparison,  has  been  found  to  be  the  most  frequently 
employed  method,  despite  its  known  limitations  (Chalfant, 
1984;  Frankenberger  &  Fronzaglio,   1991).     This  method  fails 
to  correct  for  the  regression  toward  the  mean  phenomenon  and 
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results  in  the  overidentif  ication  of  high  IQ  students  and 
the  underidentif ication  of  low  IQ  students.     One  explanation 
for  states'  reluctance  to  adopt  regression  methods  is  that 
few  studies  have  attempted  to  systematically  compare  other  . 
discrepancy  methods  with  regression  procedures.     The  sparse 
amount  of  research  comparing  the  various  methods  on  actual  * 
subjects  has  led  to  the  present  study.  ;  ■ 

Several  regression  formulas  exist,  with  some  reported 
to  be  much  better  than  others.     Additionally,  although 
regression  discrepancy  methods  are  employed  to  correct  for 
regression  toward  the  mean  effects,  some  regression  formulas 
fail  to  do  this.     For  example,  Reynolds'   (1984-1985)  Model 
Three  (Frequency  of  Regression  Prediction  Discrepancy)  is 
the  recommended  choice  of  discrepancy  methods,  due  to  its 
adequate  correction  for  regression  toward  the  mean  effects. 
Reynolds  (1984-1985)  also  reported  on  another  regression 
formula.  Model  Four  (Regression  Estimates  of  True 
Discrepancy  scores),  which  he  criticized  as  not  properly 
correcting  for  the  regression  between  IQ  and  achievement. 
This  model,  therefore,  is  reported  to  have  the  same  problems 
as  the  Simple  Difference  method,  namely  the 
underidentif ication  of  students  with  below  average  IQ's  and 
the  overidentif ication  of  students  with  above  average  IQ's. 

The  present  study  systematically  compared  the  effects 
of  three  different  discrepancy  methods.     The  first  method 
employed  was  the  Simple  Difference  method.     The  Simple 


Difference  method  is  the  most  frequently  used  method, 
despite  its  failure  to  correct  for  regression  toward  the 
mean  effects.     The  second  method  employed  was  Reynolds' 
(1984-1985)  Model  Three  regression  method.     The  rationale 
for  selecting  this  method  is  based  on  claims  that  this  model 
is  superior  to  others  and  highly  recommended  for  use  (Evans, 
1992;  Reynolds,  1984-1985;  Shepard,  1989;  Willson  & 
Reynolds,  1984-1985).     This  method  reportedly  corrects  for 
regression  toward  the  mean  effects.     The  third  method 
employed  is  the  method  recently  under  consideration  by  the 
Florida  Department  of  Education.     This  method  employs 
formulas  which  are  mathematically  equivalent  to  Reynolds' 
Model  Four  regression  procedure.     This  method  independently 
evaluates  the  difference  between  regressed  achievement  and 
regressed  aptitude  scores  (regressed  as  a  function  of  the 
measures'  unreliability).     It  is  predicted,  however,  to  have 
the  same  shortcomings  as  the  Simple  Difference  method, 
namely  the  failure  to  correct  for  regression  effects. 

The  effects  of  each  method  on  the  proportion  of 
students  identified  were  analyzed.  It  was  hypothesized  that 
the  methods  would  identify  different  proportions  of  students 
overall.  Additionally,  it  was  hypothesized  that  significant 
differences  would  exist  between  methods  in  the  proportion  of 
students  identified  at  different  ability  levels  (i.e.,  IQ 
above  100  and  IQ  below  100). 


The  purpose  of  this  study  is  to  illustrate  selection 
bias  in  determining  LD  eligibility  due  to  regression  toward 
the  mean  effects.     This  study  was  conducted  using  an  actual 
school  sample.     The  determination  of  selection  bias,  as  a 
function  of  discrepancy  method,  has  implications  for  theory 
and  practice  in  the  field  of  learning  disabilities. 


LITERATURE  REVIEW 
History 

School  psychologists  spend  the  majority  of  their  time 
in  services  related  to  assessment  (Kranzler,  1992).     Most  of 
these  services  are  provided  to  students  with  mild 
disabilities,  and  students  with  learning  disabilities  (LD) 
comprise  the  largest  proportion  of  this  group  (Reschly, 
Genshaft,  &  Binder,  1987).     Some  researchers,  however, 
(Reschly,  1988;  Ysseldyke,  Algozzine,  Richey,  Se  Graden, 
1982)  have  guestioned  the  usefulness  of  LD  assessment 
services  altogether,  due  to  a  long  history  of  problems 
within  the  LD  field.     Indeed,  the  field  of  learning 
disabilities  is  one  that  has  been  riddled  with  controversy, 
inconsistency  and  confusion  since  its  inception  (Algozzine  & 
Ysseldyke,  1986;  Hammill,  1990;  Kavale  &  Forness,  1992). 

Due  to  the  contributions  of  numerous  disciplines  (e.g., 
medicine,  language,  psychology,  and  education),  historically 
there  has  been  no  clear  consensus  regarding  what  to  call 
this  population  (Mercer,  1992).     Over  two  decades  ago,  for 
instance,  Cruikshank  (1972)  identified  40  different  labels 
for  this  population  found  in  research  articles  and  state 
guidelines.     Chalfant  (1985)  cited  five  descriptors 
referring  to  this  population  in  state  guidelines  at  that 
time.     These  represent  the  following  three  distinct  terms: 
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learning  disability,  perceptual  impairment,  and  perceptual 
communication  disorder. 

The  literature  is  replete  with  discussions  of  the 
sources  of  controversy,  which  stems  from  confusion  in 
terminology,  definition,  diagnostic  criteria,  and  treatment 
of  learning  disabilities.     Current  trends  suggest  that 
professionals,  legislators,  and  parents  are  making  an 
organized  effort  toward  improving  some  of  the  problems 
(Mercer,  1992).      Nevertheless,  a  great  amount  of 
controversy  and  inconsistency  still  exist  (Algozzine  &  . 
Ysseldyke,  1982;  Algozzine,  Ysseldyke,  &  Shinn,  1982; 
Frankenberger  &  Fronzaglio,  1991;  Kavale  &  Forness,  1987; 
Mercer,  King-Sears  &  Mercer,  1990;  Torgesen,  1986).  Some 
researchers  (Algozzine,  1985;  Algozzine  &  Ysseldyke,  1983; 
1986;  Reschly,  1988)  question  the  appropriateness  of  this 
category  altogether,  proposing  that  the  determination  of 
eligibility  for  services  be  based  simply  on  need  (i.e., 
underachievement)  and  not  on  a  set  of  predetermined, 
arbitrary  criteria  for  placement  into  special  education. 
These  individuals  have  suggested  that  low  achievement  be 
recognized  as  reason  enough  for  attempts  at  remediation  to 
occur.     Other  professionals  continue  to  believe  that  what  is 
most  needed  is  further  refinement  in  LD  theory  and 
assessment  practices  (Adelman  &  Taylor,  1986;  Frankenberger 
&  Fronzaglio,  1991;  Kavale  &  Forness,  1987;  Morris,  1988; 
Torgesen,   1986) . 
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Definition  and  Prevalence  of  LP 
The  term  learning  disability  (LD)  was  first  used  in 
1962  by  Samuel  Kirk  to  describe  a  broad  collection  of 
disorders  related  to  school  failure  that  could  not  be         ^       .  ; 
attributed  to  other  known  forms  of  exceptionality  or 

■X- 

environmental  disadvantage  (Algozzine  &  Ysseldyke,  1983;        -  . 

McKinney,  1984;  Kirk  &  Kirk,  1983).     Between  1962  and  1969,  ,, 

many  attempts  were  made  to  revise  this  definition.     In  1969 

a  definition  was  presented  to  Congress  by  The  National 

Advisory  Committee  On  Handicapped  Children  (Kirk  &  Kirk, 

1983).     This  definition  served  as  the  basis  for  the  1969 

Learning  Disabilities  Act.     In  1977  this  definition  was 

incorporated  into  Public  Law  (PL)  94-142,  the  Education  for 

All  Handicapped  Children  Act,  and  still  stands  as 

governmental  policy  today  (Kirk  &  Kirk,  1983): 

"Specific  learning  disability"  means  a  disorder  in  one 
or  more  of  the  basic  psychological  processes  involved 
in  understanding  or  in  using  language,  spoken  or 
written,  which  may  manifest  itself  in  an  imperfect 
ability  to  listen,  think,  speak,  read,  write,  spell,  or 
to  do  mathematical  calculations.     The  term  includes 
such  conditions  as  perceptual  handicaps,  brain  injury, 
minimal  brain  dysfunction,  dyslexia,  and  developmental 
aphasia.     The  term  does  not  include  children  who  have 
learning  problems  which  are  primarily  the  result  of 
visual,  hearing,  or  motor  handicaps,  of  mental 
retardation,  of  emotional  disturbance,  or  of 
environmental,  cultural,  or  economic  disadvantage. 
(USOE,  Federal  Register,  1977,  p.  65083,   121a. 5) 

Since  the  enactment  of  PL  94-142  in  1977,  the  number  of 

children  receiving  special  education  services  for  a  learning 

disability  has  increased  by  152%  ( Frankenberger  & 

Fronzaglio,  1991).     In  addition,  there  is  variability  among 
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states  in  the  number  of  students  identified  as  having  a 
learning  disability  (Frankenberger  &  Fronzaglio,  1991; 
Frankenberger  &  Harper,  1987).     While  the  number  of  students 
identified  as  having  a  learning  disability  has  increased, 
populations  identified  as  having  speech  impairments  and 
mental  retardation  have  decreased  over  time  (Frankenberger  & 
Harper,  1987).     Kavale  and  Forness  (1987)  point  out  that  the 
steady  increase  in  the  learning  disabled  population  includes 
students  "only  marginally  qualified  for  inclusion  but  who 
seem  to  fit  because  of  the  ill-defined  boundaries"  (p.  374). 
Kavale  and  Forness  (1992)  predict  that  both  the  incidence 
and  prevalence  will  continue  to  increase  and  will  vary  from 
state  to  state. 

Telzrow  (1985)  attributes  the  increased  identification 
of  children  with  learning  disabilities  to  the  movement  to 
locate  LD  children  and  fill  the  special  classes  that  were 
funded  in  the  1970s.     In  fact,  school  psychologists  and 
others  were  reported  to  have  encouraged  teachers  to  refer 
large  numbers  of  children  who  simply  were  not  achieving  up 
to  grade  level  (Telzrow,  1985).     Chalfant  (1985)  cites  the 
following  factors  as  contributing  to  the  increase:   (a)  lack 
of  alternative  services  available  to  underachievers ,  (b) 
parental  pressures  on  educators,    (c)  impaired  decision 
making  processes  of  multidisciplinary  teams,    (d)  poorly 
defined  mainstreaming  services,  and  (e)  measurement 
problems.     Currently,  the  prevalence  of  LD  is  seen  by  some 
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(Reschly,  1988)  as  a  problem  which  may  undermine  the 
credibility  of  those  who  diagnose  it.     It  is  believed  that 
the  number  of  students  served  in  LD  programs  will  only 
continue  to  increase  if  low  achieving  students  in  need  of 
remedial  services  are  continually  classified  and  placed  in 
special  education  (Reschly,  1988). 

Researchers  have  also  proposed  that  the  increase  in 
prevalence  and  the  variability  among  states  stems  from  the 
confusion  over  the  definition  of  LD  (Epps,  Ysseldyke,  & 
Algozzine,  1985),  and  from  inconsistencies  in  states' 
identification  criteria  and  procedures  ( Frankenberger  & 
Fronzaglio,  1991;  Kavale  &  Forness,  1992).     Hammill  (1990) 
reviewed  28  recently  published  textbooks  and  identified  11 
different  definitions  of  a  learning  disability.  These 
included  definitions  that  are  prominent  now  as  well  as  those 
that  have  been  popular  in  the  past.     Of  these  11  definitions 
however,  he  believes  that  only  four  are  professionally 
viable  today  (one  of  which  is  the  federal  definition). 
Hammill  cautions  that  the  federal  definition  and  criteria 
were  developed  for  the  purpose  of  guiding  funding  practices 
associated  with  federal  school  legislation.     He  believes, 
therefore,  that  they  were  not  intended  as  a  comprehensive 
theoretical  statement  about  the  nature  of  learning 
disabilities.     In  spite  of  this,  the  most  widely  accepted 
definitions  in  use  today  are  the  federal  definition  and  the 
definition  written  by  the  National  Joint  Committee  on 
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Learning  Disabilities  (NJCLD)  in  1988.     The  NJCLD  definition 
differed  from  the  federal  definition  in  that  it  eliminates 
the  term  "basic  psychological  process,"  recognizes  LD  across 
the  life  span,  emphasizes  the  heterogeneity  of  LD,  and 
stresses  the  medical  model  that  LD  is  intrinsic  to  the 
individual  and  presumed  to  be  due  to  CNS  dysfunction.  This 
definition  was  formulated  with  the  goal  of  improving  the 
federal  definition,  however  some  researchers  believe  that  it 
is  simply  an  extension  of  it  (Hammill,  1990).     The  other  two 
viable  definitions  are  those  proposed  by  the  Learning 
Disabilities  Association  in  1986  (LDA,  formerly  ACLD),  and 
The  Interagency  Committee  On  Learning  Disabilities  (ICLD) 
(Hammill,  1990). 

A  1989  survey  revealed  that  57%  of  states  at  that  time 
used  the  federal  definition  or  some  variation  of  it  (Mercer, 
King-Sears,  &  Mercer,  1990).     That  was  a  decrease  from  1983 
when  72%  of  states  were  using  some  form  of  the  federal 
definition  (Mercer,  Hughes,  &  Mercer,  1985).     A  more  recent 
survey  by  Frankenberger  and  Fronzaglio  (1991)  supports  these 
findings.     Mercer  et  al.   (1990)  believe  that  it  is  the 
increase  in  the  LD  population  that  has  prompted  the  field  to 
continue  searching  for  a  definition  and  set  of  criteria  that 
can  more  clearly  determine  eligibility  for  services. 

Major  Components  of  the  LD  Definition 

Two  separate  surveys  examined  the  definitions  used  by 
states'  Departments  of  Education  (Mercer  et  al . ,  1985; 
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Mercer  et  al . ,  1990).     Although  variation  in  states'  LD 
definition  and  criteria  was  present,  according  to  these 
surveys,  the  1977  federal  definition  did  appear  to  have  a 
significant  impact.     These  surveys  found  that  despite  using 
the  federal  definition  less  frequently,  states  have  retained 
certain  major  components.     The  six  components  that  are 
commonly  considered  in  defining  and/or  identifying  learning 
disabilities  are  as  follows:     (a)  intelligence,  (b) 
exclusion,   (c)  academic  achievement,   (d)  neurological 
deficits,   (e)  discrepancy,  and  (f)  process-language. 
Intelligence  Component 

The  intelligence  component  refers  to  the  intellectual 
ability  level  of  individuals  evaluated  for  possible  LD.  The 
only  reference  to  intelligence  in  the  federal  definition 
however,  is  made  in  the  exclusion  section,  which  states  that 
"the  term  does  not  include  children  who  have  learning 
problems  which  are  primarily  the  result  of  .   .   .  mental 
retardation"  (USOE,  Federal  Register,  1977,  p.  65083).  The 
Frankenberger  and  Harper  survey  (1987)  found  that  most 
states  follow  the  federal  definition  by  simply  excluding 
children  with  IQ  scores  in  the  mentally  retarded  range.  A 
more  recent  survey,  however  (Frankenberger  &  Fonzaglio, 
1991)  revealed  that  the  number  of  states  specifying  IQ 
cutoffs  has  increased.     According  to  their  survey.  Mercer  et 
al.   (1990)  indicated  that  1)  intelligence  is  not  explicitly 
stated  by  57%  of  the  states,  2)  18%  of  the  states 
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require  that  students  have  average  or  above  average 
intelligence,  and  3)  12%  require  that  the  student  have  an  IQ 
above  that  specified  for  mental  retardation. 

t' 

Exclusion  Component  »  ' 

The  exclusion  component  delineates  characteristics 
which  would  exclude  children  from  being  identified  as  having 
a  learning  disability.     This  includes  the  presence  of  - 
another  exceptionality  (e.g.,  mental  retardation,  emotional 
disturbance,  vision  or  hearing  impairment  etc.)  or  exposure 
to  adverse  environmental,  cultural,  or  economic  conditions 
that  result  in  lack  of  opportunity.     Kavale  and  Forness 
(1987)  believe  that  this  practice  has  inherent 
classification  problems.     First,  these  characteristics  are 
exclusionary  only  if  they  are  considered  to  be  the  primary 
cause  of  a  learning  problem.     It  is  possible,  however,  for 
one  of  these  handicaps  to  co-exist  if  it  can  be  determined 
that  it  is  not  the  primary  problem  (Mercer  et  al.,  1990). 
Additionally,  Kavale  and  Forness  (1987)  point  out  that  when 
learning  disabilities  are  defined  in  terms  of  what  they  are 
not,   instead  of  what  they  are,  they  become  a  residual 
disorder.     In  other  words,  a  learning  disability  reflects 
underachievement  not  explained  by  anything  else.  A 
comparison  of  surveys  conducted  by  Mercer  et  al.  (1985, 
1990)  indicates  that  this  component  is  increasingly  being 
used  by  states. 
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Academic:  Component 

The  academic  component  refers  to  difficulties 
manifested  in  reading,  writing,  spelling,  or  performing 
mathematical  calculations.     Hammill  (1990)  found  that  the 
only  element  all  11  definitions  reviewed  in  his  survey  agree 
upon  is  the  idea  that  all  individuals  with  a  learning 
disability  are  underachievers .     Surveys  by  Mercer  et  al. 
(1985,  1990)  indicate  that  this  continues  to  be  a  basic 
factor  in  defining  and  identifying  LD,  and  Frankenberger  and 
Fronzaglio  (1991)  found  that  all  states  include  this 
component  in  their  definition.     The  results  of  studies  by 
Algozzine,  Ysseldyke,  and  Shinn  (1982)  and  others  support 
the  idea  that  this  is  largely  a  category  of 
underachievement.     Some  researchers  (Epps,  Ysseldyke,  & 
McGue,  1984)  conclude  that  the  degree  of  achievement  deficit 
should  be  considered  when  determining  eligibility  for  LD 
placement. 

Discrepancy  Component 

The  discrepancy  component  refers  to  how  achievement 
deficits  are  interpreted.     Discrepancies  between  academic 
areas  (i.e.,  achievement  strengths  and  weaknesses),  or 
between  ability  and  achievement  in  one  or  more  academic 
areas  (i.e.,  aptitude-achievement  discrepancies),  may  be 
quantified  in  several  ways,  and  states  differ  greatly  in  the 
discrepancy  criteria  utilized.     Surveys  by  Mercer  et  al. 
(1985,   1990)  found  an  increase  in  the  percentage  of  states 
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that  include  the  discrepancy  component  in  either  their 
definition  or  criteria,  from  84%  in  1983  to  88%  in  1989. 
Similarly,  Frankenberger  and  Fronzaglio  (1991)  found  an 
increase  in  the  number  of  states  that  include  an 
ability/achievement  discrepancy  component  in  their  criteria. 
This  increased  over  the  last  nine  years  from  16  states  in 
1981-1982  to  37  states  in  1989-1990.     The  manner  in  which 
states  choose  to  operationalize  a  discrepancy,  however, 
accounts  for  the  most  variation  between  states.;  ., 
Neurological  Component 

The  neurological  component  includes  the  consideration 
of  central  nervous  system  (CNS)  dysfunction  in  individuals 
with  learning  disabilities.     This  component  assumes  that 
deficient  performance  on  intellectual  tasks  is  due  to  damage 
or  malfunction  of  certain  areas  of  the  brain  (Torgesen, 
1986),  such  as  with  brain  injury  or  minimal  brain 
dysfunction  (Kavale  &  Nye,  1981).     Adelman  and  Taylor  (1986) 
indicate  a  move  away  from  linking  learning  disabilities  to 
neurological  dysfunction,  resulting  partly  from  the 
practical  difficulties  related  to  diagnosis.     Mercer  et  al . 
(1990)  found  that  64%  of  the  states  assume  the  position  that 
CNS  dysfunction  may  be  a  part  of  LD.     In  terms  of  criteria 
however,  only  4%  of  states  require  evidence  of  CNS 
dysfunction  and  only  52%  refer  to  this  component  in  their 
definition.     Frankenberger  and  Fronzaglio 's  (1990)  survey  of 
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states'  criteria  revealed  a  decrease  over  time  in  the  number 
of  states  that  include  this  component. 
Process-Language  Component 

The  last  component  identified  by  Mercer  et  al.  (1985, 
1990)  is  the  process-language  component.     This  refers  to 
possible  dysfunction  in  the  psychological  processes  involved 
in  the  proficient  performance  of  a  skill  or  ability. 
Processes  such  as  perception,  memory,  attention,  and     ;^  • 
psycholinguistic  skills  are  included  in  this  component 
(Kavale  &  Nye,  1981).     Process  factors  have  been  the  topic 
of  a  great  amount  of  investigation  and  controversy;  however, 
research  has  not  supported  the  use  of  process  tests  in 
identification  or  treatment  (Kavale  &  Forness,  1987;  Mercer 
et  al.,  1990).     Despite  this,  in  1989,  92%  of  states  had 
incorporated  this  component  in  their  definition  and/or 
criteria,  an  increase  from  86%  in  1983. 

Mercer  et  al.   (1990)  indicated  that  the  following  three 
components:     (a)  process-language,   (b)  exclusion,  and  (c) 
discrepancy,  were  increasingly  being  used  by  states,  whereas 
the  remaining  three  components:     (a)  intelligence,  (b) 
neurological  deficits,  and  (c)  academic,  remained  fairly 
constant  in  usage.     Comparison  survey  results  reveal  that 
states  are  revising  their  definitions  and  criteria  for  LD 
placement  (cf.  Mercer  et  al.,  1985,  1990).     Mercer  et  al. 
(1990)  conclude  that  states  are  attempting  to  implement 
better  ways  to  identify  students  with  learning  disabilities, 
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and  that  this  reflects  an  emerging  consensus  on  the 
components  included  in  the  definition. 

T^iiqibilitv  Criteria 
In  addition  to  the  definition  of  LD,  a  set  of 
operational  criteria  was  included  in  the  Federal  Register 
(USOE  Federal  Register,  1977,  p.  65083)  to  aid  in  the 
identification  of  students  with  learning  disabilities: 

(a)  A  team  may  determine  that  a  child  has  a  specific 
learning  disability  if:  •  v.  v.  • 

(1)  The  child  does  not  achieve  commensurate  with  his  or 
her  age  and  ability  levels  in  one  or  more  of  the  areas 
listed  in  paragraph  (a)(2)  of  this  section,  when 
provided  with  learning  experiences  appropriate  for  the 
child's  age  and  ability  levels;  and 

(2)  The  team  finds  that  a  child  has  a  severe 
discrepancy  between  achievement  and  intellectual 
ability  in  one  or  more  of  the  following  areas:   (i)  Oral 
expression;   (ii)  Listening  comprehension;   (iii)  Written 
expression;   (iv)  Basic  writing  skills);   (v)  Reading 
comprehension;   (vi)  Mathematics  calculation;  or  (vii) 
mathematics  reasoning. 

(b)  The  team  may  not  identify  a  child  as  having  a 
specific  learning  disability  if  the  severe  discrepancy 
between  ability  and  achievement  is  primarily  the  result 
of:   (1)  A  visual,  hearing,  or  motor  handicap;  (2) 
Mental  retardation;   (3)  Emotional  disturbance;  or  (4) 
Environmental,  cultural  or  economic  disadvantage  (USOE, 
Federal  Register,  1977,  p.  65083,  121a. 541). 

Several  problems  exist  with  this  set  of  criteria.  For 
example,  criteria  for  operationalizing  the  process  component 
and  the  neurological  component  are  not  provided,  nor  is  any 
method  for  determining  if  a  co-existing  condition,  such  as 
emotional  disturbance,  is  the  primary  handicap  or  if  it  is 
secondary  to  the  learning  disability  (Morris,  1988). 
Additionally,  the  definition  includes  spelling  as  a  possible 
deficit  area,  yet  it  is  absent  from  the  criteria.  Finally, 


17 

the  definition  does  not  address  age  limits.     The  criteria 
refer  to  "children"  thereby  restricting  the  condition  to  a 
certain  age  group  (Hammill,  1990).     Epps,  Ysseldyke,  and 
Algozzine  (1985)  believe  that  definitional  problems  are 
responsible  for  these  problems  with  the  identification 
criteria.  .  ^  -r 

Although  federal  criteria  for  identifying  a  learning 
disability  state  that  there  must  be  a  "severe  discrepancy" 
between  achievement  and  intellectual  ability,  they  do  not 
include  specific  guidelines  or  procedures  for  determining 
when  a  discrepancy  is  "severe"  ( Frankenberger  &  Harper, 
1987).     As  a  result,  even  when  the  federal  definition  is 
adopted,  a  great  deal  is  still  left  open  to  interpretation. 
The  responsibility  for  specifying  procedures  and  criteria 
for  diagnosing  LD  has  been  assigned  to  individual  states, 
and  states  are  known  to  vary  considerably  in  this  (Mercer  et 
al.,  1990).     For  example.  Mercer  et  al.    (1990)  found  marked 
variations  in  states'  operationalization  of  a  severe 
discrepancy.     Specifically,  two  states  specified  a  2 
standard  deviation  (SD)  discrepancy  between  IQ  and 
achievement  tests'  standard  scores,  six  specified  a 
discrepancy  of  1  1/2  SD,  six  specified  1  SD,  three  states 
specified  a  SD  of  between  1  and  1  1/2  SD,  and  five  states 
varied  the  amount  of  the  SD  depending  upon  the  student's  age 
and/or  grade  level.     Only  six  states  specified  that  a 
regression  method  be  used  for  calculating  a  discrepancy. 
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Due  to  the  variation  in  states'  definitions  and 
eligibility  criteria,  students  in  one  LD  program  may  differ 
from  those  in  another  (Adelman  &  Taylor,  1986;  Kavale  &  Nye, 
1981).     Furthermore,  students  eligible  based  on  one  state's 
criteria  may  not  be  eligible  based  on  another's  (Mercer, 
1990).     Furthermore,  it  is  this  diversity  that  is  said  to 
contribute,  in  large  part,  to  the  difficulties  in 
generalizing  and  replicating  LD  research  findings  (Adelman  & 
Taylor,  1986;  Kavale  &  Nye,  1981).     It  is  a  well  known  fact 
that  the  LD  population  is  one  characterized  by  a  large 
amount  of  heterogeneity  (Mercer,  1990). 

Discrepancy  Criteria 

According  to  Hammill  (1990),  the  use  of  discrepancy 
formulas  is  one  of  the  most  intensely  debated  issues  in  the 
field  of  learning  disabilities.     When  the  federal  definition 
was  adopted  by  PL  94-142  in  1977,  an  attempt  was  made  to 
operationalize  a  "severe  discrepancy"  between  intellect  and 
achievement  by  developing  a  formula  for  calculating  a 
discrepancy  (Hammill,  1990).     This  formula  was  later  dropped 
from  the  regulations  due  to  intense  criticism  that  it 
infringed  upon  states'  rights  and  that  the  formula  had 
psychometric  inadequacies  (Hammill,  1990). 

Although  this  discrepancy  formula  was  eventually 
deleted  from  the  federal  register,  most  states  have 
designated  their  own  discrepancy  formula.     This  is  the  most 
common  method  of  quantifying  academic  deficits  to  determine 
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if  they  represent  a  severe  discrepancy  between  ability  and 
achievement  (Hammill,  1990;  Telzrow,  1985).     The  discrepancy 
between  a  child's  IQ  and  academic  achievement  scores, 
expressed  in  a  common  metric,  is  the  most  commonly  used 
criteria  for  determining  eligibility  for  LD  services 
(Chalfant,  1984).     The  Frankenberger  and  Harper  (1987) 
survey  in  1985/86  revealed  that  57  percent  of  the  states 
reported  using  achievement  discrepancy  criteria,  and  several 
specified  sophisticated  expectancy  formulas  and  regression 
analysis  techniques.     This  reflected  an  increase  over  i 
1981/82,  when  only  33  percent  of  the  states  specified 
achievement  discrepancy  criteria  (Frankenberger  &  Harper, 
1987).     Currently,  86%  of  states  include  discrepancy 
statements  in  their  criteria  (Mercer  et  al.,  1990). 
Moreover,  Frankenberger  and  Fronzaglio  (1991)  indicate  that 
states  are  moving  toward  more  sophisticated  methods  of 
quantifying  an  IQ/achievement  discrepancy.     In  conclusion. 
Mercer  et  al.   (1990)  found  that  many  states  are  making 
changes  in  their  identification  procedures  in  an  effort  to 
more  adequately  identify  LD  students.     One  factor  which  may 
impede  this  progress,  however,  is  states'  difficulty  in 
operationalizing  the  discrepancy  component  (Mercer  et  al., 
1990)  . 

Critique  of  discrepancy  methods 
There  are  four  major  methods  for  quantifying  a 
discrepancy:     (a)  grade-level  deviation,    (b)  expectancy 
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formulas,   (c)  standard-score  comparisons,  and  (d)  regression 
analysis  (Cone  &  Wilson,  1981;  Sattler,  1988;  Telzrow, 
1985).     While  there  is  general  agreement  among  measurement 
experts  that  this  hierarchy  of  methods  is  ranked  from  bad  to 
good  (respectively),  all  have  inherent  limitations  when 
applied  to  the  identification  of  children  with  learning 
disabilities  (Telzrow,  1985).     A  description  of  the  methods 
and  their  limitations  are  discussed  below. 

Grade  level  deviation  scores  refer  to  the  discrepancy 
between  the  child's  grade-equivalent  score  on  an  achievement 
test  and  his  or  her  grade  placement.  Grade-equivalent 
scores  are  notoriously  problematic  (Berk,   1982;  Reynolds, 
1981)  and  this  method  leads  to  results  that  have  different 
meaning  for  different  grade  levels  (Sattler,  1988).  Normal 
variability  in  the  population  is  also  ignored  with  this 
method  (Telzrow,  1985).     In  addition,  if  a  unitary  cutoff 
point  is  utilized  for  all  students  (e.g.,  percent  or  number 
of  years  below  grade  level),  then  this  formula  results  in 
the  identification  of  increasing  numbers  of  students  in  the 
upper  grade  levels  due  to  larger  standard  deviation  units 
(Reynolds,  1981;  Shepard,  1980).     Despite  the  inadequacies 
of  this  method,  Mercer  et  al.    (1990)  report  that  it  is  still 
used  in  a  few  states . 

Expectancy  formulas  use  combinations  of  IQ,  mental  age 
(MA),  chronological  age  (CA) ,  and  number  of  years  in  school. 
Expectancy  formulas  are  known  to  vary  widely  and  yield 


dramatically  different  results  (Berk,  1982).     These  formulas 
do  not  control  for  regression  toward  the  mean,  do  not  take 
into  account  the  correlation  between  the  tests  used 
(Sattler,  1988),  and  may  overidentify  high  IQ  children  and 
underidentify  low  IQ  children.     According  to  Tel2row  (1985), 
the  following  major  statistical  errors  that  these  formulas 
commit  are:     (a)  treating  IQ  scores  as  though  they  are  on  a 
ratio  scale;   (b)  interpreting  MA  scores  as  accurate 
representations  of  developmental  levels;  and  (c)  employing 
grade-equivalent  scores  as  the  index  of  achievement.  Grade 
equivalent  scores  do  not  have  the  mathematical  properties 
needed  for  use  in  discrepancy  analysis  (Reynolds,  1984- 
1985).     Reflecting  positively  on  current  trends.  Mercer  et 
al,   (1990)  found  an  increase  in  the  use  of  standard  scores 
instead  of  grade  equivalencies  or  expectancy  methods  when 
their  1988  survey  was  compared  to  the  results  of  the 
Frankenberger  and  Harper  (1987)  survey  in  1986. 

Standard  score  comparisons,  are  also  known  as  the 
"Simple  Difference"  method  (Braden  &  Weiss,   1988).  This 
approach  defines  a  discrepancy  as  the  difference  between  IQ 
and  achievement  test  scores,  expressed  in  a  common  metric 
(Evans,  1992).     Although  a  great  improvement  over  methods 
already  discussed,  this  approach  typically  does  not  correct 
for  test  unreliability;  therefore,  the  derived  discrepancy 
score  is  likely  to  be  unacceptably  low  in  reliability  (Berk, 
1982;  Chalfant,   1985;  Cone  &  Wilson,   1981;  Sattler,  1988; 
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Telzrow,  1985).     Additionally,  the  correlation  between  the 
IQ  and  achievement  measures  is  not  taken  into  account.  The 
reliability  of  the  derived  discrepancy  score  is  to  some 
extent  a  function  of  the  inter-test  correlation  (Salvia  & 
Ysseldyke,  1981).     Furthermore,  the  simple  difference  method 
does  not  take  into  account  the  regression  of  achievement  on 
IQ;  thus,  this  method  results  in  the  over identification  of  ' 
bright  children  and  the  underidentif ication  of  low  IQ  / 
children  (Braden,  1987;  Cone  &  Wilson,  1981;  Cone  &  Wilson, 
1983;  McLeod,  1979;  Wilson  &  Cone,  1984).     Despite  these 
known  limitations,  this  method  is  reportedly  the  most 
frequently  utilized  in  determining  LD  eligibility  (Chalfant, 
1984;  Frankenberger  &  Fronzaglio,  1991).     A  recent  survey 
(Mercer  et  al.,  1990)  found  that  30  states  have  specific 
criteria  for  operationalizing  a  severe  discrepancy,  of  which 
18  use  standard  score  comparisons  and  12  recommend 
regression  methods. 

The  regression  discrepancy  method  defines  a  discrepancy 
as  the  difference  between  expected  (i.e.,  predicted) 
achievement  and  obtained  achievement  (Evans,  1992).  This 
method  adjusts  for  the  regression  of  achievement  on  IQ  that 
results  from  imperfectly  correlated  measures  (Bennett  & 
Clarizio,   1988).     When  the  relationship  between  the  IQ  and 
achievement  measures  is  considered,  and  regression  toward 
the  mean  accounted  for,  prediction  errors  are  reduced 
(Wilson  &  Cone,  1984).     Some  regression  methods,  however,  do 


not  take  into  account  the  reliability  of  the  measures  used 
(Berk,  1982;  Shepard,  1980).     Additionally,  although 
generally  recognized  as  the  most  psychometrically  sound 
method  of  quantifying  a  discrepancy,  regression  analysis  has 
also  been  criticized  (Cone  &  Wilson,  1981).     It  has  been 
described  as  the  most  cumbersome  and  complicated  method  to 
use  (Evans,  1992;  Forness,  Sinclair,  &  Guthrie,  1983;  Wilson 
&  Cone,  1984).     Similar  to  the  other  approaches,  it  still 
requires  that  a  cutoff  score  be  established  for  the 
identification  of  what  constitutes  a  "severe  discrepancy" 
(Telzrow,  1985).     Variability  exists  in  regression 
equations,  based  on  the  values  chosen  to  define 
significance,  severity,  and  the  amount  of  measurement  error 
considered  in  the  discrepancy  (Evans,  1992).     Finally,  of 
the  different  regression  formulas  described  in  the 
literature,  some  are  arguably  much  better  than  others  (see 
e.g.,  Reynolds,  1984-1985;  Shepard,  1989). 

Regression  methods  are  generally  held  to  be  the  most 
appropriate  for  determining  a  discrepancy,  both  conceptually 
and  statistically  (Bennett  &  Clarizio,  1988;  Cone  &  Wilson, 
1981;  Sattler,   1988;  Telzrow,   1985;  Wilson  &  Cone,  1984). 
There  is,  however,  limited  empirical  research  comparing 
regression  procedures  to  other  discrepancy  methods  (Bennett 
&  Clarizio,  1988),  and  although  states  appear  to  be  moving 
toward  better  methods,  this  is  not  yet  the  method  most 
widely  employed  in  actual  practice. 
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Telzrow  points  to  other  more  general  and  pervasive 
criticisms  associated  with  the  use  of  all  discrepancy 
formulas.     These  criticisms  include  the  following:     (a)  the 
practice  of  comparing  two  tests  using  widely  discrepant 
normative  samples;   (b)  the  use  of  measures  with  unacceptably 
low  reliability  and  validity;  and  (c)  the  questionable 
practice  of  playing  the  "numbers  game" ,  which  involves 
selecting  measures  known  to  inflate  IQ  scores  or  deflate 
achievement  scores  to  qualify  a  child  (Telzrow,  1985,  p. 
433).     Additionally,  we  are  reminded  that  regardless  of  how 
the  discrepancy  is  evaluated,  unless  a  standard  method  is 
used  consistently,  a  learning  disability  is  actually  an 
arbitrarily  derived  disorder  (Algozzine,  Ysseldyke,  &  Shinn, 
1982) . 

Forness,  Sinclair,  and  Guthrie  (1983)  found  that  when 
eight  commonly  used  discrepancy  formulas  were  applied  to  the 
IQ  and  achievement  scores  of  LD  students,  extremely  variable 
results  occurred  in  terms  of  the  number  of  students 
identified  by  each  formula.     Although  the  various  methods 
can  be  adjusted  to  identify  approximately  the  same  number  of 
students,  "students  labeled  by  one  method  might  differ 
greatly  in  terms  of  such  basic  variables  as  IQ,  achievement 
level,  grade  level  at  placement,  and  degree  of 
underachievement"  (Cone  &  Wilson,  1981,  p.   370)  from  those 
labeled  by  another  method.     In  conclusion,  there  is  a  need 
to  improve  LD  identification  practices  through  the 


consistent  selection  and  use  of  a  sound  discrepancy  method 
and  unified  eligibility  criteria  across  states. 

Regression  Toward  the  Mean 

Regression  toward  the  mean  refers  to  the  phenomenon 
affecting  scores  on  two  tests  that  are  less  than  perfectly 
correlated,  such  as  intelligence,  reading,  arithmetic,  and 
spelling  scores  (McLeod,  1979).     This  phenomenon  predicts 
that  individuals  who  obtain  a  certain  score  on  one  of  these 
tests  will,  on  the  average,  obtain  a  score  nearer  to  the 
population  average  (regress  toward  the  mean)  on  the  other 
test  (McLeod,   1979).  •,         -  .  < 

For  example,  children  with  above  average  IQ  scores  tend 
not  to  obtain  equally  high  achievement  scores. 
Consequently,  simply  as  a  function  of  regression  toward  the 
mean,  these  children  are  more  likely  to  meet  LD  criteria 
than  children  with  an  average  or  below  average  IQ  if  a 
Simple  Difference  method  is  employed  (Cone  &  Wilson,  1981). 
According  to  McLeod  (1979),  if  a  group  of  children  who  each 
score  130  on  an  IQ  test  are  examined,  one  will  find  that 
their  average  reading  score  is  around  115,  not  130.  Thus, 
mathematically,  half  of  them  are  bound  to  be  15  or  more 
points  behind  their  IQ  in  reading;  thus,  if  referred  for 
evaluation,  they  are  more  likely  to  qualify  for  LD  services 
than  students  with  average  or  below  average  ability. 

Cone  and  Wilson  (1981)  warn  that  regression  toward  the 
mean  also  occurs  with  below  average  IQ  scores.     Failure  to 


26 

consider  regression  in  this  case  results  in  achievement 
expectations  that  are  too  low;  thus,  fewer  of  these  children 
meet  the  discrepancy  criteria  for  LD  services.  Braden 
(1987)  states  that  when  the  Simple  Difference  method  is 
used,  the  combination  of  the  choice  of  tests,  the 
correlation  between  these  tests,  and  the  child's  IQ, 
significantly  impacts  on  the  probability  of  identification. 
A  difference  between  two  standard  scores  represents  various 
probabilities  of  LD  eligibility  depending  upon  these  factors 
(Braden,  1987). 

The  Simple  Difference  discrepancy  method  does  not  take 
into  account  the  correlation  between  achievement  and  ability 
measures.     Braden  (1987)  indicates  that  when  an  achievement 
test  and  an  IQ  test  are  highly  correlated,  and  thus 
regression  effects  minimized,  then  the  overall  LD 
identification  rate  is  lower  and  more  evenly  distributed 
across  IQ  intervals.     When  the  correlation  is  moderate, 
however,  the  overall  LD  identification  rate  more  than 
doubles  and  differs  greatly  between  high  and  low  IQ 
intervals.     In  other  words,  the  tendency  of  the  Simple 
Difference  method  to  underidentif y  students  with  low  IQ's 
(and  vice-versa  for  high  IQ's)  becomes  more  pronounced  as 
the  correlation  between  IQ  and  achievement  measures 
decreases  (Evans,  1992). 

Researchers  have  demonstrated  that  the  use  of  certain 
discrepancy  methods  has  the  potential  of  discriminating 
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against  certain  populations  (Braden,  1987;  Braden  &  Weiss, 
1988;  Furlong,  1988;  McLeskey,  Waldron,  &  Wornhoff,  1990;). 
For  example,  Braden  (1987)  compared  regression  and  Simple 
Difference  methods  for  determining  IQ-achievement 
discrepancies  on  a  hypothetical  sample.     Due  to  the 
difference  in  African-American  and  caucasion  students'  mean 
ability  scores,  it  was  demonstrated  that  the  Simple 
Difference  method  produced  disproportionate  racial  . 
representation  (due  to  regression  effects),  whereas  the 
regression  method  did  not. 

Braden  (1987)  showed  that  when  the  method  used  for  LD 
placement  is  a  Simple  Difference  discrepancy  between  IQ  and 
achievement  test  scores,  black  students  have 
disproportionately  low  representation  in  LD  classes,  in  part 
due  to  regression  effects  (Braden,  1987).     Braden  (1987) 
used  hypothetical  data  to  illustrate  how  the  use  of  the 
Simple  Difference  method  at  low  IQ  levels  translated  into 
disproportionate  racial  representation.     This  bias  was 
attributed  to  black  students'  lower  mean  IQ  scores. 
Similarly,  Evans  (1992)  points  out  that  disproportionate 
underrepresentation  or  overrepresentation  of  any  subgroup 
varying  in  mean  IQ  may  occur  when  the  Simple  Difference 
model  is  used. 

According  to  Braden  (1987),  the  fluctuation  in 
identification  rates  based  upon  IQ  may  violate  children's 
Fourteenth  Amendment  rights  to  equal  protection  under  the 
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law  (i.e.,  overlabeling  some  groups  and  denying  access  to 
services  for  others).     Algozzine,  Shinn,  and  McGue  (1982) 
state  that  "the  effects  of  being  inappropriately  labeled  as 
LD  are  equivocal;  the  advantage  is  clearly  that  being  so 
labeled  entitles  one  to  receive  special  services  for 
academic  underachievement"  (p.  74).     The  continued  use  of 
questionable  methods  may  lend  support  to  the  arguments  of 
researchers  who  believe  that  contemporary  practices  of 
identifying  learning  disabilities  are  founded  on  logically 
fallacious  grounds  (Algozzine  &  Ysseldyke,  1983,  1986; 
Reschly,  1988). 

In  summary,  when  regression  is  not  taken  into  account 
when  calculating  discrepancies  for  LD  placement  (e.g.,  when 
using  the  Simple  Difference  method),  higher  IQ  children  are 
likely  to  overidentif ied  and  overlabeling,  whereas  lower  IQ 
children  may  experience  the  denial  of  needed  services. 
According  to  Braden  (1987),  the  continued  use  of  this 
discrepancy  method  is  difficult  to  defend. 

Related  Studies 

Braden  and  Weiss  (1988)  compared  the  effects  of  using 
the  Simple  Difference  method  and  regression  analysis  for  LD 
identification,  utilizing  a  "real"  sample  (i.e.,  actual 
students).     Researchers  in  this  study  applied  both  methods 
to  a  sample  of  non-referred  students.     The  data  consisted  of 
second  grade  (n  =  1074)  and  fifth  grade  (n  =  1139)  students' 
group  IQ  scores  (OLSAT)  and  group  reading  and  math 
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achievement  scores  (MAT) .     This  study  demonstrated  that 
Simple  Difference  discrepancies  did  correlate  significantly 
with  IQ  and  produced  disproportionate  racial  composition  for 
both  grades.     In  contrast,  regression  discrepancies  did  not 
correlate  with  IQ.     They  reported  that  their  study  supports 
"theoretical  propositions  that  Simple  Difference 
discrepancies  vary  in  magnitude  and  frequency  depending  upon 
the  correlation  between  the  two  tests,  and  as  a  function  of 
the  child's  IQ"  (p.  139).     They  concluded  by  saying  that 
continued  use  of  the  Simple  Difference  method  may  constitute 
ethical  and  legal  malpractice. 

Bennett  and  Clarizio  (1988)  systematically  compared  the 
following  four  discrepancy  methods:     (a)  z-score 
discrepancy,   (b)  estimated  true  score  discrepancy,   (c)  a 
regression  procedure  that  considers  only  errors  of  estimate 
(unadjusted  regression  procedure),  and  (d)  a  regression 
procedure  that  also  includes  an  adjustment  for  test 
unreliability  (adjusted  regression  procedure).     This  last 
procedure  is  equivalent  to  Reynolds'   (1984-1985)  Model 
Three,  also  known  as  the  Frequency  of  Regression  Prediction 
Discrepancy.     This  study  improved  upon  previous  studies  in 
that  it  utilized  an  actual  sample  of  students  that  had  been 
referred  for  psychological  evaluation,  and  individual 
(instead  of  group)  IQ  and  achievement  data  were  gathered. 
The  sample  of  students  (N  =  86)  consisted  of  children 
referred  due  to  suspected  learning  disability.  Subjects 
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were  administered  the  Wechsler  Intelligence  Scale  for 
Children  -  Revised  (WISC-R)   (Wechsler,  1974).     The  mean  IQ 
of  the  total  sample  was  94.9.     The  mean  IQ  of  the  students 
identified  by  each  method  was  not  reported.     Results  showed 
that  the  different  methods  yielded  different  proportions  of 
identified  students.     Overall,  the  unadjusted  regression 
procedure  selected  the  smallest  number  of  students. 
Additionally,  in  many  paired  comparisons,  a  lack  of 
agreement  existed  in  the  actual  students  identified  by  each 
method  (i.e.,  the  number  of  students  who  were  identified  by 
both  methods ,  divided  by  the  total  number  of  students 
identified  by  the  methods  separately) .     Bennett  and  Clarizio 
(1988)  concluded  that  the  four  methods  could  not  be  used 
interchangeably . 

Evans  (1992)  examined  the  outcome  that  could  be 
anticipated  following  a  change  from  the  use  of  a  Simple 
Difference  method  to  a  regression  discrepancy  method.  Evans 
compared  differences  between  the  two  methods  in  overall 
identification  rate,  as  well  as  differences  in 
identification  rates  by  race,  grade,  and  time  of  evaluation 
(i.e.,  initial  or  re-evaluation).     A  moderate  correlation  of 
.60  between  the  WISC-R  and  the  Woodcock-Johnson 
Psychoeducational  Battery  (Revised)  -  Tests  of  Achievement 
(WJ-R)  was  adopted  for  use,  due  to  a  lack  of  actual  WJ-R  and 
WISC-R  intercorrelation  values  for  a  normal  population. 
Evans  hypothesized  that  Simple  Difference  discrepancies 
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would  be  biased  by  IQ,  as  well  as  by  any  divisions  that 
created  groups  differing  in  mean  IQ.     As  groups  in  this 
sample,  black  students  were  found  to  have  a  lower  mean  IQ 
than  white  students,  secondary  level  students  were  found  to 
have  a  lower  mean  IQ  than  elementary  students,  and  students 
referred  for  a  re-evaluation  were  found  to  have  a  lower  mean 
IQ  than  the  group  of  students  referred  for  an  initial 
evaluation.     Evans  found  that  the  groups  with  lower  mean 
IQ's  (i.e.,  black  students,  secondary  students,  and  re- 
evaluated students)  had  a  smaller  percentage  of  students 
identified  as  LD  when  the  Simple  Difference  method  was  used. 
Consequently,  Evans  concluded  that  the  secondary  biases 
found  for  race,  grade,  and  re-evaluation,  were  not 
independent,  but  that  all  resulted  directly  from,  or  were 
confounded  by  IQ.     The  mean  IQ  in  Evans'  total  sample  of 
students  was  88.73  (SD  =  11.83).     The  median  IQ  of  students 
identified  only  by  the  Simple  Difference  method  (median  IQ: 
108;  range:  92-110)  differed  from  those  identified  only  by 
the  regression  model  (median  IQ:   78.5:  range:   70-96).  Evans 
concluded  that  students  with  lower  Full  Scale  Intelligence 
Quotients  (FSIQs)  were  less  often  identified  as  having  a 
severe  discrepancy  when  the  Simple  Difference  method  was 
used.     Evans  also  concluded  that  school  districts  moving 
from  the  Simple  Difference  method  to  the  regression  method 
could  experience  a  great  deal  of  outcome  differences,  even 
with  small  samples  from  a  small  district. 
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Regression  Method-q  Relevant  to  Current  Study 
Of  the  various  regression  discrepancy  methods,  one  in 
particular  has  received  considerable  attention  and  praise  in 
the  literature  (Evans,  1992;  Reynolds,  1984-1985;  Shepard, 
1989;  Willson  &  Reynolds,  1984-1985).     This  method  was 
proposed  by  Reynolds  (1984-1985)  and  is  the  Frequency  of 
Regression  Prediction  Discrepancy  (Model  Three).     It  has  ,v 
been  offered  as  one  of  the  most  statistically  sound  methods 
of  identifying  students  with  a  severe  discrepancy  between 
ability  and  achievement.     This  method  involves  regressing 
achievement  on  IQ  to  obtain  a  predicted  achievement  score. 
A  severe  discrepancy  is  determined  to  exist  when  the 
difference  between  the  predicted  achievement  score  and  the 
obtained  achievement  score  is  significant.     This  model  also 
takes  into  account  the  reliability  of  the  difference  score. 

Another  discrepancy  model  discussed  in  the  literature 
is  referred  to  by  Reynolds  (1984-1985)  as  Regression 
Estimates  of  True  Discrepancy  Scores  (Model  Four).  Although 
this  method  at  first  seems  appealing,  it  has  serious 
shortcomings  (Reynolds,  1984-1985;  Shepard,  1989).  When 
this  model  evaluates  a  regressed  difference  score,  it 
evaluates  the  difference  between  regressed  achievement  and 
regressed  IQ  scores.     These  scores  are  regressed  as  a 
function  of  their  unreliability.     In  other  words,  this  model 
"examines  the  difference  between  the  obtained  IQ  and 
achievement  scores  that  have  been  independently  regressed 


toward  their  respective  means  on  the  basis  of  measurement 
error,  as  estimated  by  the  internal  consistency  reliability 
of  each  instrument"  (Kranzler,  1993,  p.  24).     This  method 
does  not,  however,  take  into  account  the  correlation  between 
achievement  and  IQ.     For  this  reason,  it  is  not  an 
acceptable  method  because  it  can  be  criticized  on  the  same 
grounds  as  the  Simple  Difference  method.     Reynolds  (1984- 
1985)  does,  however,  state  that  Model  Four  is  appropriately 
used  when  measures  have  low  reliability.     Of  course,  most 
tests  in  use  today  have  reasonably  high  reliabilities. 

The  Florida  Department  of  Education  is  presently 
considering  the  adoption  of  a  proposed  SLD  rule  change.  The 
proposed  change  to  section  C  of  Rule  6A-6. 03018  includes  the 
adoption  of  a  regression  formula  that  is  mathematically 
equivalent  to  Reynolds'   (1984-1985)  Model  Four. 
Specifically,  the  formulas  for  determining  a  difference 
score  and  the  formula  for  calculating  the  standard  deviation 
of  this  difference  score  distribution  are  equivalent  to 
Reynolds'  formulas.     For  purposes  of  clarity,  this  method 
will  be  referred  to  as  the  "proposed  State  model"  from  this 
point  forward. 

Rationale  for  Current  Study 
The  existence  of  a  significant  discrepancy  between  IQ 
and  achievement  continues  to  be  an  important  criterion  in 
diagnosing  a  learning  disability  under  Public  Law  94-142 
(Mercer  et  al.,  1990).     The  Simple  Difference  method  (i.e.. 
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standard  score  comparison)  of  computing  a  discrepancy  is 
reported  to  be  the  most  commonly  used  method  to  determine 
whether  a  severe  discrepancy  between  IQ  and  achievement 
exists  (Chalfant,  1984).     This  method,  however,  does  not 
correct  for  regression  toward  the  mean  effects. 
Consequently,  Braden  (1987)  predicts  that  once  an  individual 
is  referred  for  evaluation,  certain  statistical  properties 
influence  the  likelihood  of  being  identified  as  having  a 
learning  disability  if  this  method  is  used.     Few  studies 
actually  examining  the  influence  of  this  various  methods  on 
eligibility  outcomes  have  been  conducted  across  IQ  levels. 
Braden  and  Weiss  (1988)  blame  the  paucity  of  empirical  data 
comparing  discrepancy  methods  on  "real"  populations  as  one 
reason  for  the  continued  reliance  on  the  Simple  Difference 
method  despite  warnings.     Although  the  criticisms  of  the 
Simple  Difference  method  are  derived  from  sound  theoretical 
bases,  empirical  studies  on  real  populations  are  needed 
(Braden  &  Weiss,  1988).     For  example,  Braden  (1987)  used 
only  a  "hypothetical"  sample  in  his  study.     Although  Braden 
and  Weiss  (1988)  used  a  "real"  sample,  they  examined  a  group 
of  non-referred  students,  and  used  group  IQ  and  achievement 
data.     Of  those  few  studies  that  have  employed  a  "real" 
sample  of  referred  students  with  individual  test  data 
(Bennett  &  Clarizio,  1988;  Evans,  1992),  only  one  has 
specifically  examined  the  influence  of  IQ  on  LD 
identification  rates  (Evans,  1992). 


The  primary  purpose  of  this  study  is  to  further 
investigate  the  effects  of  different  discrepancy  methods  on 
LD  identification  rates.     This  study  consists  of  a  sample  of 
students  referred  for  suspected  LD.     It  seeks  to  improve 
upon  previous  related  studies  by  utilizing  a  "real"  sample 
of  referred  students,  and  uses  data  gathered  from  individual 
psychological  evaluations.     Additionally,  this  study  will 
examine  the  differences  between  methods  in  the  overall 
proportion  of  students  identified,  as  well  as  between  IQ 
subgroups.     Based  on  previous  research,  it  is  hypothesized 
that  low  IQ  students  will  be  less  likely  to  evidence  a 
severe  discrepancy  when  the  Simple  Difference  method  is 
employed.  ;  ^ 

The  rationale  for  determining  if  bias  exists  (when  a 
particular  method  is  used),  rests  on  the  practical  use  of 
such  information  and  on  the  contribution  it  can  make  to  the 
field  of  learning  disabilities.     If  bias  is  found  to  exist 
when  certain  methods  are  used,  this  evidence  will  further 
support  the  use  of  alternate  discrepancy  methods.  The 
results  of  a  study  such  as  this  could  prove  useful  in 
states'  selection  of  a  discrepancy  method.     Mercer  et  al . 
(1990)  indicated  a  trend  in  which  states  are  in  fact, 
attempting  to  more  adequately  identify  students  with  a 
learning  disability  by  improving  "best  practice"  discrepancy 
criteria  and  methods  for  operationalizing  their 
identification  procedures. 
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In  this  study,  the  IQ  and  achievement  test  scores  of 
children  referred  for  psychological  evaluations  were 
examined.     All  of  the  children  were  referred  due  to  academic 
difficulties  and  were  suspected  of  having  a  learning 
disability.     This  study  focused  on  a  comparison  of  three 
different  discrepancy  methods  and  their  effects  on 
eligibility  outcomes.     One  of  the  methods  examined  is 
currently  used  in  Florida,  therefore  the  effect  of  moving  to 
an  alternate  method  was  also  examined. 

This  study  seeks  to  determine  whether  selection  bias 
exists  in  the  determination  of  eligibility  for  LD  services 
as  a  result  of  regression  toward  the  mean  effects.     If  as 
predicted,  the  use  of  a  particular  discrepancy  method  with  a 
real  population  produces  bias  in  eligibility,  this  will  have 
implications  for  the  field.     It  is  recognized  that  the 
severe  discrepancy  criteria  is  only  one  of  a  number  of 
considerations  for  determining  eligibility.  However, 
because  it  is  a  widely  used  criterion,  its  effects  are  being 
examined  exclusively.     This  study  addresses  the  following 
questions  of  practical  importance  to  school  psychologists, 
special  educators,  law  makers  in  the  field  of  education,  and 
researchers:     (a)  Will  different  procedures  result  in 
different  proportions  of  students  identified  or  will  the 
selection  differences  be  minimal?,  and  (b)  Once  referred  for 
evaluation,  what  is  the  effect  of  IQ  upon  students' 


likelihood  of  meeting  the  discrepancy  criteria  for 
eligibility  in  an  LD  program? 


Hypotheses 

Hypothesis  #  1  '  ■   *  «. 

Ho: 

There  is  no  significant  difference  in  the  overall  proportion 
of  students  identified  as  LD  between  the  Simple  Difference 
method,  Reynolds'  Model  Three  regression  method,  and  the 
proposed  State  regression  method. 
Hil 

There  is  a  significant  difference  in  the  proportion  of 
students  identified  as  LD  between  the  Simple  Difference 
method,  Reynold's  Model  Three  regression  method,  and  the 
proposed  State  regression  method. 
Hypothesis  #  2 
Ho; 

There  is  no  significant  difference  between  discrepancy 
methods  in  the  proportion  of  students  identified  as  LD  who 
have  IQs  >  100  versus  students  who  have  IQs  <  100. 
HI: 

There  is  a  significant  difference  between  discrepancy 
methods  in  the  proportion  of  students  identified  as  LD  who 
have  IQs  >  100  versus  students  who  have  IQs  <  100. 


METHOD 
Subjects 
Demographic  Characteristics 

The  study  sample  consisted  of  students  (N  =  75) 
referred  for  psychoeducational  evaluation  in  Martin  County, 
Florida.     Based  on  figures  from  the  91-92  school  year,  the 
Martin  County  school  system  serves  over  12,200  students. 
This  population  includes  students  ranging  from  children  of 
migrant  farm  workers  in  the  rural  area  of  Indiantown  to 
those  from  upper-middle  class  families  in  the  affluent 
Stuart  areas.     The  racial  mix  of  students  attending  school 
in  this  county  is  as  follows:  White  (non-Hispanics)  (79%); 
Black  (non-Hispanic)  13%;  Hispanic  6%;  Asian  1%;  American 
Indian;  Alaskan;  and  Other  <  1%.     The  racial  mix  of  the 
sample  was  as  follows:  77%  White,  13%  Black,  3%  Hispanic,  0 
Other,  which  closely  mirrored  percentages  in  the  county. 

Thirty-two  percent  of  the  students  in  this  study  were 
female  and  68  %  of  the  students  were  male.     Students  ranged 
in  grade  level  from  kindergarten  through  grade  eleven.  The 
grade  breakdown  is  as  follows:  Kindergarten  (n  =  1),  first 
(n  =  12),  second  (n  =  17),  third  (n  =  20),  fourth  (n  =  6), 
fifth  (n  =  4),  sixth  (n  =  3),  seventh  (n  =  4),  eighth  (n  = 
2),  ninth  (n  =  3),  tenth  (n  =  2),  and  eleventh  (n  =  1). 
Students  ranged  in  age  from  6  years,  4  months  to  16  years, 
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10  months,  with  a  mean  of  9.8  years  and  a  standard  deviation 
of  2.7  years. 

Test  Performance  ■  , 

Wechsler  Intelligence  Scale  for  Children  -  Third 
Edition  (Wechsler,  1991)  Full  Scale  Intelligence  Quotients 
(FSIQs)  ranged  from  70  to  127  with  a  mean  of  96  and  a 
standard  deviation  (SD)  of  13,1.     The  students'  group 
achievement  test  scores  (based  on  Normal  Curve  Equivalent 
values)  on  the  California  Achievement  Test  (CAT)  were  as 
follows:     Mean  =  34.5  ,  SD  =  16.2  for  Total  Reading  (n  = 
33);  Mean  =  44.3,  SD  =  12.9  for  Total  Math  (n  =  32).  Group 
achievement  scores  were  not  available  for  every  student. 

All  students  included  in  the  sample  were  referred  for 
an  initial  psychoeducational  evaluation  due  to  academic 
difficulties  and  a  suspected  learning  disability. 
Evaluations  took  place  between  November  1991  and  April  1993. 
Each  student  was  evaluated  individually  by  a  certified 
school  psychologist  or  supervised  school  psychology  intern. 
Intelligence  and  achievement  tests  are  routinely  given  as 
part  of  the  larger  battery  according  to  State  of  Florida 
requirements,  however  the  determination  of  an  IQ/achievement 
discrepancy  is  only  one  of  several  considerations  in 
determining  LD  eligibility. 

Only  students  who  were  referred  due  to  possible 
learning  difficulties  were  included  in  this  study.  Students 
with  FSIQs  of  less  than  70  were  excluded  from  this  study 
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because  they  would  likely  satisfy  the  criteria  for  Mental 
Retardation.    Additionally,  students  with  a  history  of 
behavioral  or  emotional  difficulties  were  excluded  from  the 
study  due  to  possible  confounding  effects.     All  remaining 
students  with  complete  data  sets  (IQ  and  achievement  scores) 
were  included. 

Procedure 

As  part  of  the  diagnostic  assessment,  each  student  was 
evaluated  by  a  school  psychologist  or  supervised  intern 
using  several  psychometric  instruments.     As  part  of  this 
process,  each  student  in  this  study  had  been  administered 
the  Wechsler  Intelligence  Scale  for  Children  -  Third  Edition 
(WISC-III)  and  either  the  Kaufman  Test  of  Educational 
Achievement  (KTEA)  or  the  Woodcock- Johnson  Psychoeducational 
Battery  (Revised)  -  Tests  of  Achievement  (WJ-R) .  Students 
administered  the  WJ-R  (n  =  47)  are  referred  to  as  Subsample 
One  (WJ-R).     Students  administered  the  KTEA  (n  =  28)  are 
referred  to  as  Subsample  Two  (K-TEA) .     The  FSIQ  was  used 
from  the  WISC-III.     On  both  achievement  tests,  scores  for 
all  administered  subtests  were  used.     The  KTEA  included  the 
following  subtests;     (a)  Math  Application,   (b)  Reading 
Decoding,   (c)  Spelling,   (d)  Reading  Comprehension,  and  (e) 
Math  Computation.     The  WJ-R  included  the  following  subtests; 
(a)  Letter-Word  Identification,   (b)  Passage  Comprehension, 
(c)  Calculation,   (d)  Applied  Problems,   (e)  Dictation,  (f) 
Proofing,  and  (g)  Spelling.     These  subtests  yielded  the 
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following  cluster  scores,  which  also  were  considered;  (h) 
Broad  Reading,   (i)  Broad  Math,  and  (j)  Basic  Writing. 

Analysis 

Each  student's  FSIQ  and  achievement  scores  were 
compared  by  each  of  the  following  methods:     (a)  Simple 
Difference  comparison,   (b)  Reynolds'  Model  Three  regression 
method,  and  (c)  the  regression  method  proposed  by  the 
Florida  Department  of  Education,  for  adoption.     This  method 
is  referred  to  as  the  proposed  State  model.     The  relevant 
equations  for  the  Simple  Difference  discrepancy  formula  are 
presented  in  Table  1 . 

Table  1 

Simple  Difference  Discrepancy  Formula  fz  score  form) 


Criteria:        -  Zy  >  1  or  1.5 


where ; 

Zx  =  standard  score  on  ability  measure 

Zy  =  standard  score  on  achievement  measure 

1=1  standard  deviation  difference  (for 

students  ages  6  -  10) 
1.5  =  1.5  standard  deviation  difference 

(for  students  ages  11  and  above) 
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First,  each  student's  raw  scores  for  the  FSIQ  and 
achievement  subtests  were  converted  to  standard  scores  (mean 
=  100;  SD  =  15).     Second,  Simple  Difference  discrepancies 
were  calculated  for  each  student  on  every  achievement 
subtest.     The  difference  score  was  defined  as  the  obtained 
FSIQ  z.  score  minus  the  obtained  achievement  test  z  score  (Z^ 
-  Zy)  for  each  subtest.     The  difference  score  was  calculated 
in  this  same  manner  for  each  student;  however,  the  severe 
discrepancy  criteria  differed  based  on  age.     This  conforms 
to  the  Florida  Department  of  Education  guidelines. 

The  relevant  equations  for  Reynolds'   (1984-1985)  Model 
Three,  the  Frequency  of  Regression  Prediction  Discrepancy 
method  (Reynolds,  1984-1985),  are  presented  in  Table  2. 
First,  for  each  subtest,  the  predicted  achievement  z.  score 
(Yi),  based  on  the  student's  FSIQ,  was  calculated  for  each 
subtest.     The  difference  score  for  each  subtest  was  defined 
as  the  predicted  achievement  z.  score  minus  the  obtained 
achievement  z.  score  (Yi  -  Y).     The  standard  deviation  and 
standard  error  of  the  difference  score  were  also  calculated. 
A  discrepancy  was  defined  as  severe  in  Model  Three  when  the 
difference  score  equalled  or  exceeded  two  times  the  standard 
deviation  of  the  difference  distribution  Y^  -  Y,  minus  the  z 
corresponding  to  the  one-tailed  .05  alpha  level,  multiplied 
by  the  standard  error  of  the  relevant  difference  score. 
Reynolds  (1984-1985)  recommended  this  procedure  for 
determining  both  the  severity  of  the  difference  score  and 


for  taking  into  account  the  less  than  perfect  reliability  of 
the  difference  score. 


Table  2 

Reynolds^  Model  Three:   C z-score  form) 


Criteria:        -  Y  >  2  SD^  (1  -  r%)^^"  -  1.65  SE^^.^ 


where ; 

Yi  =  predicted  achievement  score:     (X)  (r^y) 
Y  =  obtained  achievement  score 

SDy  =  standard  deviation  of  achievement  measure 

(1  -  r%y)^'^  =  standard  deviation  of  the  distribution  Y^  -  Y 

SEyi.y  =  standard  error  of  the  residual  Yi  -  Y: 

(1  -  r^y)^^^     (1  -  r,,.y)^^^ 
^Yi-Y  =  reliability  of  the  residual  score  Y^  -  Y: 

£yy  —  L^xxJ  xyJ  — — SX— xy 


Note .     r^,  =  reliability  of  aptitude  measure,  ryy  = 
reliability  of  achievement  measure.  r,y  =  correlation 
between  aptitude  and  achievement  measures.  X  =  obtained 
aptitude  score 

The  regression  model  under  consideration  by  the  Florida 
Department  of  Education  is  similar  to  Reynolds'  (1984-1985) 
Model  Four  regression  procedure  (see  Table  3). 
For  this  model,  the  regression  weights  for  the  achievement 
score  and  the  aptitude  score  were  first  calculated.  Then, 
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Table  3 

Proposed  State  regression  model 


Criteria:  D  >  1.75  (SDo) 


where;     D  =  regression  estimate  of  true  discrepancy: 

b„y,  (Y  -  100)  +  b„,y  (X  -  100) 
SDd  =  standard  deviation  of  the  distribution  of  D: 
15  [b%,  +  b%,y  +  2  (b„yj   (b„,y)  r^yV'' 
and,        bny^  =  regression  weight  for  achievement  score: 

£(y  ~  C^xxJ  L^xy-)  ^yy — — — xy  ;  ■ 

1  -  r^ 

boxy  =  regression  weight  for  aptitude  score: 
r     —  —  r     +  (  t   )   ( T  ) 

is-xx  s — xy  is-xy  '  L^yy-i  i^^xy-M. 


Note .     Variables  are  based  on  Reynolds'  Model  Four  formulas. 
Y  =  obtained  achievement  score.  X  =  obtained  aptitude  score. 
X  and  Y  are  expressed  as  a  standard  score  with  a  mean  of  100 
and  a  SD  of  15.  r^y  =  correlation  between  aptitude  and 
achievement  measures,  r^^  =  reliability  of  aptitude  measure. 
Tyy  =    reliability  of  achievement  measure. 

based  on  these  values,  the  difference  score  (D)  was 
calculated.     The  formula  for  determining  the  difference 
score,  referred  to  by  the  State  as  the  "Regression  Estimate 
of  True  Discrepancy,"  and  the  formula  for  determining  the 
standard  deviation  of  this  difference  score  are 
mathematically  equivalent  to  Reynold's  (1984-1985)  Model 


Four.     The  only  difference  between  the  two  models  is  in  the 
criteria  for  determining  if  the  difference  score  is 
"severe."    Reynolds  (1984-1985)  recommended  the  use  of  two 
standard  deviations  of  the  difference  score,  as  well  as  the 
use  of  a  confidence  interval  based  on  a  one-tailed  test  with 
a  .05  alpha  level,  multiplied  by  the  standard  error  of  the 
difference  score.     The  proposed  State  model  defines  a 
discrepancy  as  "severe"  when  the  difference  score  exceeds 
the  value  of  1.75  multiplied  by  the  standard  deviation  of 
the  difference  score.  .  ^  >  "  ,. 

To  test  the  first  hypothesis,  discrepancies  for  each 
student  were  calculated  for  each  subtest  and  it  was 
determined  if  the  discrepancy  was  "severe".     Students  were 
coded  as  either  "identified"  or  "not  identified"  according 
to  each  of  the  three  discrepancy  methods.     State  criteria 
for  LD  identification  requires  that  at  least  one 
IQ/achievement  comparison  yields  a  severe  discrepancy.  For 
each  subsaraple,  the  proportion  of  students  identified  by 
each  method  was  calculated. 

A  Cochran  Q  test  (Siegel,  1956)  was  performed  to 
determine  whether  the  proportions  of  students  identified  by 
the  three  different  discrepancy  methods  were  different. 
This  non-parametric  test  was  considered  to  be  the  most 
appropriate  test  for  three  reasons.     First,  there  are  more 
than  two  related  groups.     Second,  assumptions  needed  for  a 
parametric  test  could  not  be  satisfied  (i.e.,  that  the 
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samples  were  randomly  selected,  and  that  samples  were  drawn 
from  normally  distributed  populations  with  equal  variances). 
Third,  the  data  were  in  the  form  of  dichotomous  values. 

The  Sign  Test  (Siegel  &  Castellan,  1988)  was  used  to 
perform  ad  hoc  pairwise  comparisons  between  discrepancy 
methods.     The  Sign  test  was  appropriate  in  this  case  because 
two  related  samples  were  used  with  dichotomous  data.  This 
test  does  not  make  any  assumptions  about  the  form  of  the 
distribution  of  differences,  nor  does  it  assume  that  all 
subjects  are  drawn  from  the  same  population  (e.g.,  age,  sex, 
intelligence,  etc).     A  two-tailed  test  of  significance  was 
selected  because  no  prediction  was  made  regarding  the 
direction  of  the  difference.     Instead,  the  frequencies  with 
which  the  +  or  -  signs  (i.e.,  identified/not  identified) 
differ  between  methods  were  predicted  to  be  significant.  In 
keeping  with  this  procedure,  matched  pairs  with  the  same 
sign  were  dropped  from  the  analysis  and  n  was  reduced 
accordingly.     Values  for  n  therefore,  represent  the 
frequency  of  sign  differences  (i.e.,  unmatched  pairs) 
between  the  two  methods.     Tabled  probability  values  are 
based  on  the  number  of  unmatched  pairs  and  k  (the  number  of 
fewer  signs,  +  or  -).     The  smaller  n  is,  the  greater 
agreement  there  is  in  selection  between  methods. 

In  order  to  test  the  second  hypothesis,  students  in 
each  subsample  were  separated  into  two  subgroups.     The  first 
subgroup  consisted  of  students  with  FSIQs  below  100  (IQ  < 


100)  and  the  second  subgroup  consisted  of  students  with  Full 
Scale  IQ  scores  above  100  (IQ  >  100).     No  student  scored 
exactly  100  in  either  sample.     The  proportion  of  students 
identified  as  LD  from  each  subgroup  was  then  calculated,  as 
well  as  the  mean  FSIQ  of  all  students  identified  by  a 
particular  method.      *  '  , 

The  reliabilities  of  the  FSIQ  and  achievement  subtests 
are  presented  in  Table  4.     All  reliability  coefficients  are 
based  upon  the  internal  consistency  found  in  the  tests'    '  • 
technical  manuals.     The  WISC-III  FSIQ  reliability  of  .96 
represents  the  mean  reliability  across  ages  six  to  16 
(Wechsler,  1991).     The  reliabilities  of  the  WJ-R  and  the 
KTEA  subtests  also  represent  mean  reliabilities  for  each 
subtest,  across  ages  six  to  16. 

Achievement  and  IQ  test  intercorrelations  are  presented 
in  Table  5.     Actual  WISC-III  and  WJ-R  intercorrelation 
values  were  not  available  for  a  normal  population  at  the 
time  of  this  writing,  therefore,  a  moderate  correlation  of 
.60  was  used.     This  value  was  used  by  Evans  (1992)  for  the 
same  reason.     The  intercorrelations  between  the  WISC-III  and 
each  KTEA  subtest  were  based  on  a  study  by  American  Guidance 
Service  (1992)  and  were  calculated  for  the  following  age 
groups;   (a)  ages  6-7,   (b)  ages  8-10,  and  (c)  ages  11-13. 
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Table  4 

Reliability  Coefficients  for  WJ-R  subtests.  K-TEA  subtests ^ 
and  WISC-III  Full  Scale 

Test/Subtest  Reliability  Coefficients 


Woodcock  -  Johnson  (Revised) 

Letter-Word  Identification  .94 

Passage  Comprehension  .90 

BROAD  READING  .95 

Calculation  .93 

Applied  Problems  .92 

BROAD  MATH  .95 

Dictation  ,91 

Proofing  ,91 

Spelling  90 

BASIC  WRITING  ,93 
Kaufman  -  Test  of  Educational  Achievement 

Math  Application  ,92 

Reading  Decoding  ,95 
Spelling 

Reading  Comprehension  ,93 

Math  Computation  92 
Wechsler  Intelligence  scale  for  Children  -  Third  Ed. 
Full  Scale 
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Table  5 

WJ-R  and  K-TEA  Subtest  Correlations  with  the  WISC-III  Full 
Scale 


Woodcock  -  Johnson  (Revised) 

All 

Ages  * 

Letter-Word  Identification 

.60 

Passage  Comprehension 

.60 

BROAD  READING 

.60 

Calculation 

.60 

Applied  Problems 

.60 

BROAD  MATH 

■  ■■-           ■  '■> 
9     •*  - 

.  60 

Dictation 

.60 

Proofing                                            '         ^.  . 

*  .  V  -.r  - 

.60 

Spelling                                        ^      -       _  '.. 

i 

.60 

BASIC  WRITING 

.60 

*  Approximate  correlations  based  on  Evans 

(1992)  . 

Kaufman  -  TEA  Ages  6-7        Ages  8-10  Ages  11-13 


Math  Application 

.  71 

.77 

.83 

Read  Decoding 

.57 

.73 

.70 

Spelling 

.56 

.73 

.64 

Reading  Comprehension 

.60 

.80 

.  84 

Math  Computation 

.58 

.70 

.74 

RESULTS  AND  DISCUSSION 
Results 

The  mean,  range,  and  standard  deviation  of  test  scores 
for  Subsample  One  (WJ-R)  and  Subsample  Two  (K-TEA)  are 
presented  in  Table  6.     WISC-III  scores  suggest  that  mean 
cognitive  functioning  for  both  samples  is  within  the  Average 
range,  with  minimal  differences  between  the  mean  Performance 
IQ  score  and  the  mean  Verbal  IQ  score.     In  Subsample  One, 
students  scored  lowest  on  the  Dictation  subtest  (mean  = 
83.9)  and  Basic  Writing  cluster  (mean  =  83.4),  highest  on 
the  Applied  Problems  subtest  (mean  =  100.1)  and  the  Broad 
Math  cluster  (mean  =  96.1).     Results  are  similar  for 
Subsample  Two,     In  this  sample,  students  scored  lowest  on 
the  Reading  Comprehension  subtest  (mean  =  87.2),  and  highest 
on  the  Math  Application  subtest  (mean  =  92.5). 

The  group  FSIQ  means  of  students  identified  by  each  of 
the  three  methods  are  listed  in  Table  7.     For  both 
subsamples,  the  mean  of  students  identified  by  the  proposed 
State  model  was  the  highest,  followed  by  the  Simple 
Difference  method,  and  then  by  Reynolds'  Model  Three.  The 
FSIQ  mean  of  students  identified  by  Reynolds'  Model  Three 
(both  subsamples)  was  most  similar  to  the  subsamples' 
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overall  FSIQ  means  and  encompassed  the  largest  range  of  FSIQ 
scores. 


Table  6 

Descriptive  Statistics  on  10  and  Achievement  Test  Scores  for 
Subsamples  One  (VIJ-R)  and  Two  fK-TEAl 


Test 

n 

Mean 

Ranae 

SR 

Subsamole  1  (VIJ-R) 

WISC-III 

Full  Scale  IQ 

47 

97.2 

75-127 

13.1 

Verbal  IQ 

47 

97.4 

73-129 

13.8 

Performance  IQ 

47 

97.7 

73-137 

14.2 

WJ-R 

L-W  ID 

47 

90.2 

56-128 

16.9 

Pass.  Comp. 

47 

93.0 

61-128 

16.3 

Broad  Read. 

47 

90.4 

53-124 

17.9 

Calcul . 

47 

93.9 

72-121 

13.7 

Appl .  Probl . 

47 

100.1 

78-132 

12.4 

Broad  Math 

47 

96.1 

74-123 

12.8 

Dictation 

47 

83.9 

49-109 

20.4 

Proofing 

46 

88.0 

60-114 

16.6 

Spelling 

44 

85.5 

56-114 

18.3 

Basic  Writing 

45 

83  .  4 

57-109 

20.4 

Subsample  2  fK-TEAl 

WISC-III 

Full  Scale  IQ  28  94.4  70-114  13.2 

Verbal  IQ  28  94.3  74-118  11.9 

Performance  IQ         28  95.7  68-121  14.3 


K-TEA 


Math  Applic. 

28 

92.5 

77-124 

13.6 

Read.  Decod. 

28 

90.0 

67-128 

15.5 

Spelling 

28 

89.9 

70-125 

15.4 

Read.  Compr. 

28 

87.2 

69-110 

15.9 

Math  Coraput. 

28 

88.7 

69-127 

16.4 
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Table  7 


Descriptive 

Statistics  on  the 

WISC-III 

FSIO  of  Students 

Identified 

by 

Each  Method 

Method 

Identified 

Mean 

Ranqe 

SD 

Sample  1 

fn  =  47) 

Simple  D 

29 

101.9 

77-127 

12.7 

Model  3 

30 

96.7 

'    v  75-127 

13.7 

State 

14 

105.6 

84-127 

13.6 

Sample  2 

(n  =  28) 

Simple  D 

13 

105.5 

94-114 

5.8 

Model  3 

15 

101.4 

87-114 

8.3 

State 

8 

107.6 

101-114 

4.2 

The  proportions  of  students  identified  by  each 
achievement  subtest  (within  each  method)  are  listed  in  Table 
8.     The  proportion  of  students  identified  in  each  subsample, 
by  each  discrepancy  method,  is  presented  in  Table  9.  This 
table  lists  the  overall  proportion  identified  in  each 
sample,  as  well  as  the  proportion  identified  in  each 
sample's  IQ  subgroups.     Model  Three  identified  the  greatest 
number  of  students  overall,  followed  by  the  Simple 
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Table  8 

Proportion  of  Stnr^f^nts  Identified  Across  Achievement 
Subtests 


Proportion  Identified  By  Each  Method 
Tests  n  Simple  D  Model  3  State 


Subsample  1  fWJ-R) 


Woodcock- Johnson  f Revised^ 


L-W  ID 

47 

.  26 

.19 

.11 

Pass.  Comp. 

47 

.13 

.21 

.09 

Broad  Read. 

47 

.19 

.17 

.09 

Calcul . 

47 

.  21 

.15 

.09 

Appl .  Probl . 

47 

.02 

.00 

.00 

Broad  Math 

47 

.06 

.04 

.02 

Dictation 

47 

.34 

.38 

.15 

Proofing 

46 

.  28 

.33 

.  09 

Spelling 

44 

.41 

.41 

.09 

Basic  Writing 

45 

.44 

.36 

.13 

Subsample  2  fK-TEA) 


Kaufman-TEA 


Math  Applic. 

28 

.11 

.18 

.04 

Read.  Decod. 

28 

.21 

.07 

Spelling 

28 

.29 

.18 

.11 

Read .  Compr . 

28 

.36 

.29 

.14 

Math  Comput. 

28 

.18 

.  18 

.14 

Difference  method.     The  proposed  State  model  identified  the 
smallest  number  of  students.     These  findings  were  consistent 
for  both  subsamples.     With  the  exception  of  Reynolds'  Model 
Three  in  Subsample  One,  more  students  were  identified  from 
the  IQ  >  100  subgroup  than  the  IQ  <  100  subgroup. 
Generally,  the  proportion  of  students  identified  from  the 
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upper  and  lower  IQ  subgroups  appeared  to  be  most  equitable 
when  Model  Three  was  used. 
Hypothesis  One 

A  Cochran  Q  test,  comparing  the  three  discrepancy 
methods,  was  performed  on  the  overall  proportion  of  students 
identified  by  each  method  (in  each  subsample).     Q  is 
distributed  approximately  as  Chi-square  with  df  =  k  -  1 
(Siegel,  1956,  p.  165).     Specific  values  of  Q.  and  the  level 
of  significance  for  these  differences  is  shown  in  Table  9. 

Table  9 

Percentage  Identified  with  a  Severe  Discrepancy  by  Group  and 
by  Method 


Group  n  Simple  D      Model  3      State      Cochran  0 


Subsample  1  fWJ-R) 

Overall      47                 62  64            30  ***  21.91 

IQ<100         28                   46  68             14  ***  21.38 

IQ>100         19                   84  58             53  **  10.33 

Subsample  2  (K-TEA) 

Overall       28                 46  54            29  *  8.67 

IQ<100         16                   13  38             00  **  9.33 

IQ>100         12                    92  75             66  4.67 


Note,     df  =  2,  based  on  k  -  1 . 

*  E  <   .05,   **  p  <   .01,    ***  2  <  .001 

For  Subsample  One,  the  difference  between  the  proportion  of 
students  identified  by  the  three  methods  is  significant 
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ro  (2,  n  =  47)  =  21.91,  E  <  .001].     For  Subsample  Two,  this 
difference  is  also  significant  [Q  ( 2 ,  n  =  28 )  =  8 . 67 ,  e  < 
.05].     For  both  subsamples.  Model  Three  identified  the 
largest  proportion  of  students  (over  half  of  the  referred 
students),  followed  by  the  Simple  Difference  method,  and, 
finally,  by  the  proposed  State  model,  which  identified  less 
than  one  third  of  the  referred  students. 
Hypothesis  Two 

A  Cochran  Q  test,  comparing  the  three  discrepancy 
methods,  was  performed  on  the  percentage  of  students 
identified  from  each  subsample 's  IQ  subgroups  as  shown  in 
Table  9.     A  comparison  of  the  proportion  of  students 
identified  by  each  method  (within  each  IQ  subgroup)  yielded 
a  significant  difference  for  both  the  IQ  <  100  and  IQ  >  100 
subgroups  of  Subsample  One.     In  this  subsample,  the 
selection  differences  between  methods  for  the  IQ  <  100 
subgroup  is  significant  [Q  (2,  n  =  28)  =  21.38,  2  <  .001], 
as  is  the  difference  between  methods  for  the  IQ  >  100 
subgroup  [Q  (2,  n  =  19)  =  10.33,  g  <  .01].     In  Subsample 
One,  Reynolds'  Model  Three  identified  the  largest  proportion 
of  students  in  the  IQ  <  100  subgroup  and  the  Simple 
Difference  method  identified  the  largest  proportion  of 
students  in  the  IQ  >  100  subgroup. 

In  Subsample  Two,  a  significant  difference  between 
methods  is  found  only  for  the  IQ  <  100  subgroup,   [Q  (2,  n  = 
16)  =  9.33,  e  <  .01].     Consistent  with  findings  from 
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Subsample  One,  Reynolds'  Model  Three  was  the  method  that 
identified  the  largest  proportion  of  students  in  the  IQ  < 
100  subgroup  and  the  Simple  Difference  method  identified  the 
largest  proportion  of  students  in  the  IQ  >  100  subgroup. 
Additionally,  for  both  samples,  higher  levels  of 
significance  were  reached  for  differences  between  methods 
for  the  IQ  <  100  subgroup  versus  the  IQ  >  100  subgroup. 
Pairwise  Comparisons  of  Discrepancy  Methods 

Ad  hoc  pairwise  comparisons  between  discrepancy  methods 
were  performed  to  establish  which  conditions  were 
significantly  different  from  each  other.     This  was 
accomplished  by  looking  at  the  identification  outcome  for 
each  subject  (by  method)  and  then  comparing  these  two 
conditions.     The  Sign  Test  (Siegel  &  Castellan,  1988)  was 
used  to  perform  this  analysis.     Results  are  reported  in 
Table  10.     For  five  of  the  comparisons  reported  in  Table  10, 
values  were  not  available,  due  to  the  small  n  once  matched 
pairs  were  dropped  from  the  analysis.     This  indicates  a 
higher  level  of  selection  agreement  between  methods. 
Hypothesis  One 

For  Subsample  One  overall,  pairwise  comparisons  of 
methods  (Table  10)  revealed  significant  differences  between 
the  Simple  Difference  method  and  the  proposed  State  model 
(E  <  .002),  and  between  Reynolds'  Model  Three  and  the 
proposed  State  model  (^  <  .002).     In  both  cases,  the 
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Table  10 

Probability  Values  for  Pairwise  Comparisons  Within 
Subsamples  One  fWJ-Rl  and  Two  (K-TEA) 


Methods 

Group      Simple  D/Model  3      Simple  D/State      Model  3 /State 


Subsample 

1  rwj-Ri 

Overall 

£<1.0 

(n=13) 

*  E<. 

002  (n=15) 

*  £<. 

002 

(n=16)  • 

IQ<100 

2< .  07 

(n=8) 

*  p<. 

004  (n=9) 

*  P<. 

002 

(n=15)  ;i 

IQ>100 

£< . 062 

(n=5) 

*  E<. 

032  (n=6) 

E  = 

7 

(n=l) 

Subsample  2  fK-TEAl 

Overall      p<.688  (n=6)            e<.062  (n=5)  *  e<.016  (n=7) 

IQ<100         £<.124    (n=4)              E  =  ?      (n=2)  *  Q.K.032  (n=6) 

IQ>100        Q  =  ?     (n=2)            E  =  ?     (n=3)  E  =  ?  (n=l) 


Note.  alpha=.05,  two-tailed  test 
*  significant  difference  observed 
?  =  tabled  values  were  not  available  for  n  <  3. 

proposed  State  model  identified  significantly  fewer 
students.     In  Subsample  Two  overall,  a  significant 
difference  was  observed  only  in  the  comparison  of  Reynolds' 
Model  Three  and  the  proposed  State  model  (e  <  .016).  Here, 
the  proposed  State  model  identified  significantly  fewer 
students . 
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Hypothesis  Two 

For  the  IQ  subgroups,  pairwise  comparisons  of  the  three 
discrepancy  methods  revealed  several  significant  differences 
(Table  10).     For  the  IQ  <  100  subgroup  in  Subsample  One,  a 
significant  difference  was  observed  between  students 
identified  by  the  Simple  Difference  method  and  those 
identified  by  the  proposed  State  model  (p  <  .004).  The 
proposed  State  model  identified  significantly  fewer 
students.     In  the  IQ  <  100  subgroup,  a  significant 
difference  was  observed  in  the  comparison  of  Reynolds'  Model 
Three  and  the  proposed  State  model  (p  <  .002).     For  the 
IQ  >  100  subgroup,  a  significant  difference  was  observed 
only  when  the  Simple  Difference  method  and  the  proposed 
State  model  were  compared  (p  <  .032).     Here,  the  proposed 
State  model  identified  significantly  fewer  students. 

In  Subsample  Two,  only  one  significant  difference  was 
observed.     This  occurred  in  the  comparison  of  Reynolds' 
Model  Three  and  the  proposed  State  model  for  the  IQ  <  100 
subgroup  (p  <  .032).     Consistent  with  previous  findings,  the 
proposed  State  model  identified  significantly  fewer 
students . 

Discussion 

Previous  research  has  demonstrated  that  the  selection 
and  use  of  a  particular  discrepancy  method  can  impact 
significantly  on  the  LD  identification  rate  (Bennett  & 
Clarizio,  1988;  Braden,  1987;  Braden  &  Weiss,  1988;  Evans, 
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1992).     Additionally,  it  has  been  predicted  that  school 
districts  moving  from  one  method  to  another  could  realize 
appreciable  outcome  differences,  even  with  a  small  district 
(Evans,  1992). 

The  present  study  examined  the  selection  differences 
resulting  from  the  use  of  three  different  discrepancy 
methods  on  a  referred  sample.     It  was  hypothesized  that  the 
use  of  different  discrepancy  methods  would  result  in 
different  overall  proportions  of  students  identified  as 
having  a  learning  disability.     It  was  also  hypothesized 
that,  since  certain  methods  did  not  take  into  account 
regression  toward  the  mean  effects,  these  methods  would 
identify  disproportionate  numbers  of  students  within  the  two 
ability  groups.  .  ^.      .    .  ,       .  ^ 

The  results  of  this  study  must  be  interpreted  with 
caution  due  to  the  following  inherent  limitations.  The 
first  limitation  involves  the  lack  of  actual 
intercorrelation  values  for  the  tests  used  in  Subsample  One. 
This  makes  it  difficult  to  accurately  predict  regression 
effects  for  this  sample,  because  regression  toward  the  mean 
is  known  to  increase  as  the  correlation  between  the  measures 
decreases  (and  vice  versa).     A  second  limitation  involves 
the  relatively  small  size  of  the  overall  samples,  as  this 
may  decrease  the  ability  to  generalize  these  findings. 
Additionally,  the  unequal  size  of  the  two  IQ  subgroups 
prevented  making  statistical  comparisons  between  these 


groups.     A  third  limitation  involves  consequences  in  making 
multiple  comparisons  between  the  FSIQ  and  each  achievement 
subtest  in  determining  a  discrepancy.     This  practice  is 
widely  used  by  schools,  however,  Reynolds  (1984-1985) 
cautions  against  it  or  advises  the  use  of  a  correction 
procedure  when  multiple  comparisons  are  made.     He  warns  that 
making  multiple  comparisons  increases  the  likelihood  of 
obtaining  a  severe  discrepancy  and  points  out  that  the 
recommended  discrepancy  criterion  is  based  upon  a  single 
comparison  model.     A  fourth  limitation  results  from 
comparing  methods  using  different  criteria  (i.e.,  1  SD, 
1  1/2  SD,  1.75  SD,  and  2  SD) .     These  were  recommended  for 
use  within  their  respective  method,  however,  the  use  of 
different  criteria  in  comparisons,  may  have  increased  the 
chance  of  finding  significant  differences.     Future  research 
could  employ  actual  correlations  (if  available)  between  all 
tests  and  subtests  used,  improve  sample  selection 
techniques,  employ  the  same  criterion  level,  and  explore 
methods  of  controlling  the  Type  I  error  rate  due  to  multiple 
comparisons . 

Results  of  this  study  support  both  hypotheses. 
Differences  in  the  overall  proportion  of  students  identified 
by  the  three  methods  were  found.  Furthermore,  discrepancy 
methods  were  found  to  differ  in  the  selection  bias  for  IQ. 
These  data  extend  theoretical  knowledge  by  illustrating  the 
practical,  real  effects  of  the  Simple  Difference  method  and 
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two  regression  discrepancy  methods  on  LD  eligibility 
determination.     Additionally,  this  study  suggests  that  these 
outcome  differences  are  likely  to  be  realized  within  even  a 
small  sample  from  a  small  district. 

As  predicted  by  the  first  hypothesis,  significant 
selection  differences  between  discrepancy  methods  were 
observed,  indicating  that  these  methods  cannot  be  used 
interchangeably.     Significant  differences  were  revealed  when 
all  three  methods  were  compared,  as  well  as  in  three  out  of 
the  six  pairwise  comparisons  of  methods.     Overall,  the 
proposed  State  model  identified  significantly  fewer  students 
than  either  of  the  other  methods.     Interestingly,  Reynolds' 
Model  Three  was  not  found  to  differ  significantly  from  the 
Simple  Difference  model  in  the  overall  proportion  of 
students  identified  in  either  sample.     What  appears  most 
revealing,  however,  is  that  while  the  Simple  Difference 
method  and  the  proposed  State  model  consistently  appeared  to 
overidentify  students  in  the  IQ  >  100  subgroup  and 
underidentify  students  in  the  IQ  <  100  subgroup,  Reynold's 
Model  Three  regression  method  did  not.     This  is  the  only 
method  which  takes  in  to  account  regression  toward  the  mean. 

These  results  support  the  second  research  hypothesis, 
as  well  as  previous  studies'  findings,  namely,  that  the  use 
of  different  discrepancy  methods  can  result  in  differing 
degrees  of  selection  bias.     Examination  of  the  proportion  of 
IQ  <  100  and  IQ  >  100  students  identified  by  each  method 
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revealed  that  selection  differences  were  most  pronounced 
between  methods  for  the  IQ  <  100  subgroup.     All  three 
methods  were  most  similar  when  the  proportion  of  IQ  >  100 
students  were  examined;  however,  differences  still  reached 
levels  of  significance  in  one  subsample.     This  suggests  that 
when  bias  occurs,  it  is  most  likely  to  occur  for  students  in 
the  lower  ability  group.     Both  the  Simple  Difference  method 
and  the  proposed  State  model  identified  disproportionately  , 
more  students  in  the  upper  ability  group  than  in  the  lower 
ability  group.     Although  a  significance  test  was  not 
performed,  this  was  further  illustrated  in  the  discrepancy 
between  the  mean  FSIQ  of  students  identified  by  each  of 
these  methods,  when  compared  to  the  respective  FSIQ  mean  for 
that  overall  sample.     The  FSIQ  mean  of  students  identified 
by  Reynolds'  Model  Three,  on  the  other  hand,  was  most 
similar  to  that  overall  sample  FSIQ  mean.     Model  Three  had 
the  greatest  equity  in  identifying  students  across  the  range 
of  ability.     These  findings  support  the  proposition  that 
Model  Three  most  effectively  deals  with  regression  effects. 

Although  it  is  possible  to  adjust  the  criteria  in  any 
of  these  methods  to  identify  a  greater  or  lesser  number  of 
students  as  LD,  if  the  proposed  State  model  is  implemented, 
this  would  likely  result  in  a  substantial  reduction  in  the 
overall  number  of  students  identified.     More  importantly, 
regardless  of  the  overall  number  of  students  identified, 
this  method  would  not  have  corrected  for  any  of  the  current 
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regression  problems  (i.e.,  overidentif ication  of  higher  IQ 
students  and  underidentif ication  of  lower  IQ  students).  On 
the  other  hand,  this  study  supports  the  proposition  that  a 
move  from  the  Simple  Difference  method  to  Model  Three  would 
result  in  a  more  even  distribution  across  ability  levels, 
without  neccessarily  affecting  the  overall  number  of 
students  identified. 

The  current  study  supports  previous  research  findings 
demonstrating  the  shortcomings  of  the  Simple  Difference 
method.     This  study,  however,  furthers  existing  research  by 
demonstrating  similar  shortcomings  of  one  regression  model. 
As  stated  before,  the  proposed  State  model  examined  in  this 
study  is  mathematically  eguivalent  to  Reynold's  (1984-1985) 
Model  Four  regression  procedure.     Reynolds  cautioned  that 
Model  Four  has  most  of  the  shortcomings  of  the  Simple 
Difference  method.     The  current  study  supports  this  claim, 
as  the  proposed  State  model  does  appear  to  overidentify 
upper  ability  students  and  underidentify  lower  ability 
students.     Therefore,  regardless  of  the  overall  number  of 
students  identified  (i.e.,  criteria  may  be  varied)  by  the 
proposed  State  model ,  a  district  employing  this  method  would 
likely  experience  continued  problems  with  bias  due  to 
regression  effects. 

Although  much  emphasis  has  been  placed  on  discrepancy 
methods,   it  is  acknowledged  that  this  is  only  one  of  many 
considerations  neccessary  for  determining  if  a  child  is 
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eligible  for  LD  services.     First,  the  professional  should 
use  procedures  that  include  tests  with  the  highest  degree  of 
reliability  and  validity  available.     Second,  sound 
discrepancy  methods  should  be  used  as  one  indication  of  the 
child's  learning  progress  in  relation  to  an  estimated 
potential .     This  information  can  then  be  added  to 
information  provided  by  other  people  in  the  child's 
environment  (e.g.,  parents,  teachers,  special  educators). 
Finally,  it  must  be  acknowledged  that  although  useful  in  the 
identification  process,  discrepancy  methods  provide  no 
information  about  the  appropriate  treatment  for  a  learning 
disability.  ..... 

In  conclusion,  the  present  study  illustrates  the 
shortcomings  of  methods  which  fail  to  take  into  account 
regression  toward  the  mean  effects,  thus  resulting  in  bias. 
The  practical  implications  of  these  findings  are  that,  (a) 
discrepancy  methods  are  not  interchangeable,   (b)  the  Simple 
Difference  method  and  the  proposed  State  discrepancy  model 
both  fail  to  overcome  bias,  particularly  at  low  IQ  levels, 
and  (c)  the  Model  Three  discrepancy  method  distributes  the 
probability  of  qualifying  for  LD  services  more  evenly  across 
IQ  levels.     As  states  continue  to  work  toward  more 
defensible  LD  identification  practices,  findings  such  as 
these  need  to  be  considered,  and  further  research  on  real 
samples  carried  out.     This  study  thus  supports  Reynolds' 
(1984-1985)  and  other's  (Evan,  1992;  Shepard,  1989;  Willson 
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&  Reynolds,  1984-1985)  claims  that  Model  Three  is  not  only 
psychometrically  sound,  but  viable  for  implementation  as  a 
best  practice  discrepancy  method. 
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